Hey William,
It sounds like a settings issue. Keep in mind that computer monitors are inherently progressive, and so video looks different than on an interlaced TV set.
If I had to guess given your details, it sounds like an interlace issue. Are you using DSP’s encoder, or are you using Compressor (or something different)? It sounds like what happens when you have a field order/de-interlace setting wrong, or possibly the maximum bit rate is too high. Some set-top DVD players can’t handle really high MBRs, and can lag as a result.
I guess I’m wondering your workflow, and what exactly you mean by jittery picture.
Thanks,
Keith
My Weekly Comic for TV Techs: https://fpscomic.blogspot.com