You need to finish the werewolf attack story, bandit story and bareshade expansion (especially the more houses and the fair parts, that's where you get more interaction with him.) Also make sure you have more than 40 likes with him.
