You are supposed to wait out for the antagonist, that's the point of him going around in the same place. Eventually he does come around and you can win the game, just with patience. And the key problem is odd. Maybe you are trying to get the ladder and the key at the same time? You are supposed to get the ladder in place and then get the key. Follow the narrative and don't force it mate. You should be able to do everything if you follow the rules.