After you've built up his affection high enough and have gone hunting with him enough to at least share the bed, you can talk to him about the hot springs. After you bring it up he will invite you meet up with him Saturday and Sunday evenings (and yes, you will see him nude).