The question mark means it sees the drive but there is nothing on it.
I suggest putting your OS X CD in and re-starting the computer with that. (If you can’t eject the drive, restart the computer while holding the mouse-button down. Then restart again holding the “C” key.)
Once the CD boots, find Disc Utility in there. Format the drive, then shut down the computer, put the original drive back in its place and move the new drive down a space. Now that it’s formatted, hopefully the computer will see it properly. If it doesn’t it’s possible there’s something wrong with the cables in that bay.