I think you need to have your like high enough and then talk to the shopkeeper at night and to visit the barn with him, then you will get a scene in which you can sleep with Caleb. After that the sex with him becomes a random event while entering the barn