I am having this exact same issue.
I am using CS5. When I try to animate a camera, its as if all the other layers are one image, they move together. I can confirm the rest of the layers are in 3D. Changing X,Y,Z values moves the all layers together as if it were a still picture. Please help.