Yeah, I've actually fixed this issue on the steam build, but introduced another bug with how they delve into the dungeons, so I'm working on fixing that now. I'll update the itch build probably today or tomorrow
The reason they linger in the tavern is because I wanted to make sure there were replacements immediately so the dungeons would flow faster, but I overshot how many replacements needed to wait around.