My party disappeared when I did the soccer event first, and they were gone after that. then the priestess and others appeared when she learns divine retribution.
edit: I tried reverse order, and they're still gone after soccer event.
edit 2: get stuck on stairs for armory as well.