Hi!
I was searching about this issue on the web, I have a Quad Core PC with 16 Gb of RAM and the videos of a 7D on a separate drive, but the multicamera was playing incredibly slow, I pressed the space bar and had to wait about 3 seconds for the video to start playing.
I found a simple solution, I rendered the audio (Sequence/Render Audio) and the video played just well.
I hope this helps you with your issue!