Sorry to revive a dead thread but I was wondering if you ever made any progress with this issue?
I am having the same problem using ffmpeg and have narrowed it down to the use of segmentation, without segmentation there is no a/v drift. But I’d really like to use segmentation…
You are the only other person online I’ve seen with this issue.