When you have enough people close together, you can talk with more than two. I got it up to 4 in the tavern when I had Hayden and Rosalyn follow me, wanted to meet Gareth and then saw that Aldric was there too.
gotcha good to know and i think the only cap is the number of npc in the game right