To be able to Invite them to your Room, you need to Talk to them, at least 50 times. You can't Invite them to your Room if you barely know them or show interested in them.
I didn't realize talking to them unlocked anything other than completing daily quests. Good to know, thanks
You're welcome.
Please make sure to read the Guide next to the Mission. It gives you bonuses!