Don’t know of any way for dynamic link between AE files. I don’t know how your projects are setup but the only thing I can suggest is making all your changes in the overlay AE file, import to desired file, and ALT-Click to replace compositions manually. I know that probably isn’t the answer you were looking for but I hope you are able to figure it out.
Without know how your projects are setup, is there a way to just keep them all in one project file? That would make it more robust for if you need to go back and make changes. Maybe bring in all your other AE files into the one overlay file?
Hope this helps?