I think you need to listen to the town crier mid-day, then once you have the mountain quest, eavesdrop in the town square and you'll get an offer like slur, payment, or charisma, and he'll offer a gem to take to the cottage.
