The biggest image Ae can work with is 30,000 pixels in any dimension. Something in your comp is too big.
If you don’t know which layer it is, I suggest stepping through your comp and turning layers off one at a time until you find the culprit.
Note that some effects (like blurs, glows, drop shadows, etc.) can expand the image buffer for a layer.