Sorry for the late reply, doubt you're still stuck by now but if you are:
Red Gem goes into the case in the room next to the basement door (undo the panel with the screwdriver). That will get you the key for the Rumpus Room on the third floor of the mansion.