Remember that although Invigorator can “share” the comp camera it isn’t placing the 3D objects in the same 3D space as AE objects so there are limitations. This is more than likely the problem you are coming up against. Have you considered retexturing your object in Cinema?
JD
John Dickinson
Motionworks
http://www.motionworks.com.au