I had a similar issue. I took the original footage and used an online converter to convert the original footage from .mp4 to .mov file and whatever the error was disappeared. Hope this helps.
Seems like my file was corrupted somehow from the camera I was using. (DJI OSMO+) And converting it to a different file format tricked FCPX into fixing it.