Are you using any lights or are you just using the ambiance lighting?
About the only thing you can do to eliminate the grain is to shoot with more light. If you are trying to give the video a kind of dark look, you can always shoot it with a bit more light and darken it down in post. As long as you don’t have any harsh lighting, it should look good.