I’m usually working with that workflow not finding it too difficult to synkronize with my own eyes. If you find it to demanding or time-consuming I would suggest either the plural eyes plugin or maybe making the clips at multiclips?
If you select the wanted video and audio file in your FCP-browser you can make them a multiclip and select audio from the audio-channel and video from your video channel!
Let me know how it works!