Have you tried setting the x264 tune option to Animation?
If you go to the “Options” dialog box in the Compression Settings dialog box and then “Load Preset” in the lower left corner of the x264 settings dialog box that pops up, there is a x264 tune dropdown which allows you to select Animation.
If that doesn’t work, why not just try a normal H.264 for kicks to see what happens?