Please tell me you've at least equipped the sword and robe that are in the house.
If you did, then the only advice I can give is trying out strong attacks whenever possible.