Sounds like a better job for After Effects. If you have AE, watch a couple of tutorials on motion tracking and/or tracking with Mocha in AE. I’m not an AE motion effects creator, I’m an editor, but I’ve found it useful and reasonably easy to grasp some simple techniques like tracking. Much better than eternal manually key framing.
Bars & Tone
SALUTE!