I just had a similar issue, it appeared to happen in areas that had heavy blur/tracking/noise reduction…
I ultimately had to rend in chunks, because the failure was seemingly random, and then did a “flat pass” render throttled down to generate my XML… used Find & Replace to fix the XML and it all seems to have worked… just super frustrating, hopefully that may help…