What does the actual quest point say? The only abandoned hut I can think of is the one that you find by following Bernard, when he first turns, and then you never return to it again. Unless you mean the Cottage in the Forest.
That sounds like your normal Friday hunting trip with Bernard. That's part of the normal relationship route with Bernard which is required before you can work on the Caleb quest. Meet Bernard every chance you get at the cottage in the woods Friday nights, at the tavern after you talk to him about a night out, and regularly at the hot springs every Saturday and Sunday evening (let him pay or he'll be offended and like you less).
Repeat those steps and you'll eventually get different dialog in them and a notice that he loves you more (as in, you've gained a heart).