I did try that thanks. I finally figured out what it was. I had two layers that I had shy-ed (shied?) and they were trackmatted using the luma key, so it was screwing up shadows for any objects underneath them. When I took the luma track matte off I was able to see shadows.
Thanks for your responses though!