Thanks for the solution! Let me write out the problem again, so that someone may be able to find this easier in a search:
If you are getting pixelated, low resolution textures using RE:Map or YY_UVmapper in After Effects, make sure to render your UV map in 16bit and set your AE project higher than 8bit.
Misha