well, tracking the shot and then applying the tracking data to your roto shape is what i would do to deal with the camera movement, if theres parallax i would just do a 3d camera track and projection, google about those techniques and i bet you will find your answer