I tested it a bit. It has something to do with the video connection. If I use DVI instead of HDMI, the problem goes away.
Anyone have any idea why this is? Its strange that it only affects the preview windows. I suspect it has something to do with the Final Cut Pro gamma correction setting.