Pay attention to where the random encounters go after you beat them. There's a secret passage somewhere.
Once you have a certain succubus with you, talk to the person before the gates to get into the graveyard