Yes, unfortunately. You might be able to simplify somewhat with a clever naming convention. For example, if you named your flash layers “Flash 1”, “Flash 2”, etc. and your control layers “Control 1”, “Control 2”, etc. then you could do something like this in the Flash expression so it would be the same for every layer:
myNum = name.split(" ")[1];
segStartTime = thisComp.layer("Control " + myNum).effect("Slider Control")("Slider");
You could do a similar thing with the audio expression.