Im sorry that you experienced this :( I believe the game has a bug where if a player leaves before finding a pair, they remain as a "ghost," and the game pairs you with them if you are the next to join the game. If you leave and connect again, it should fix itself.