I should of mentioned this earlier, but you can quit a session with another player after joining them by pressing Q.
