You have to lose to the ram and get the ram scene ending and when you now lived in their house. There's also another one if you charmed them in the house.
