Check on the new version (haven't posted a patchnote yet), you should be able to teleport back to the tavern in such situations
