Technically you can cast shadows even on black object, they just remeian invisible to the eye. Anyway, it’s a moot point. Just like Adam said, render out separate shadow and light passes. It seems the trick for you will be to find the lights that affect your scene the most and isolate them into sensible groups.
Mylenium
[Pour Myl