If I remember correctly the trigger should be getting his affection bar maxed out? It's been a hot minute since I was working on his scene, but the ending you get should depend on how full the bar is
He won't let me join him tho
Are you playing the right version? It should be 0.3.1