Maybe if you don't take care of them good enough, they became fed up with you and totally was their hands of you, essentially removing themselves from the game.
