If, as you say, the “whole graphic” is moving up and down, then I would check for– fractional pixels sizes after import, stray keyframes, mis-matched frame rates, or other things that might induce a rounding error in the image placement. That’s what the symptoms sound descriptive of.
-jeff