I recently had a problem tracking: The tracker was all over the place despite any motion. Turns out the problem was due to the video being compressed with h264 and there’s no intermediate frames to track(?).
The solution was exporting to a ..lossless format and track that.
I know this reply is way to late (but I don’t know if there’s a rule against it) but maybe it will help someone in the future!
http://www.ardillamedia.com