You can trick AE’s 3d system by sandwiching an empty adjustment layer between your ground layer and the man layer. Any 3d layers below the adjustment layer will not intersect with layers above it. I have no idea why this works but I use it all the time.