Is there a mismatch between the audio khz of the sequence and the clip?
Failing that, you could try Compressor like Jon suggested, but maybe just export the audio – then you won’t be degrading the video and it’ll be quicker.
Good luck
Paddy, CreativeMedia.org.uk