Just dont flirt with him and go into the cave and make him stay. Youll see the option "if it's for the warmth"
