I’m not sure what program you’re using. I have had good success with Compressor, MPEG Streamclip, and Adobe Encoder. They all have a preset for DVD or Bluray. You might or might not have to play around with some of the settings to get it to look the very best. I’ve had it go either way.
Heidi