its not random, you need to unlock the question of asking him about the hole at night, and if you continue searching at night you find it but lose ste. but not really cause he's on the other side of the fence.
