I have linked QT files in 8.6.3.
I get the first attached error when trying to transcode.
Same camera files worked fine in 8.4.2, starting to think
8.6.3 is the issue here.
Also cannot use Send To from timeline for QT ref either,
in this case my second screen shot copied from the Console.