[Sverrir Fridriksson]

Only thing I can think of is to click on event pan/crop on your clip, zoom in a bit so you have a little wiggle room for the motions, and then move the clip around and adding keyframes. I tested this and you can get OK results with it, but it will be a hassle to add this to a long clip.