Kenji’s reaction to being asked about Aoba is surprise because “How does this guy who’s lived with us for a few months know about someone I knew over a decade ago?” But when reminiscing, he’s happy about it because, as he said “Although [he] lost [his] mother, it felt like [he] still had both parents.” And it’s then that he realizes that Rintaro and Aoba were more than friends, and Kenji is disappointed that his father wasn’t open about the relationship.
As for his “jealousy” Rintaro really is spending less time with him. Imagine if the only person in your life started telling you “I can’t hang out, I have other things to do” and starts to distance themselves. Meanwhile l, your new roommate is getting all schmoozy with them. Not hard to put two and two together and figure out why you’re getting ignored.