[Eric Larson]

Thanks for the tips.
I will watch your rotoscoping video.

The reason I was hopeful there might be a solution for the complicated scenario is because there is stand alone software called “Dartfish” that NBC uses at the Olympics that allows for camera to move and zoom. But it costs $4000. So I thought if any program might be able to do it, it would be After Effects.

A solution I had in my head was kind of based on what you do for motion compensated deinterlacing. But instead of having two fields from one video you would take a field from two videos and line them up.