Oh my god I just found the one series of events to make that option appear, holy fuck that's not clear at all
Just dont flirt with him and go into the cave and make him stay. Youll see the option "if it's for the warmth"
