This happens sometimes but I'm not sure why. Best I can say is don't stay for too long in a minigame. Save more often.
