When using a door, could the game be paused or enemy AI be disabled? because right now when using a door the world does not pause, meaning that enemies can kill you while going through a door, or even camp the door, so the moment you go back you might instantly die from a lot of enemies being right at the door.
If the enemies stopped chasing, or the game paused while going through a door it would solve those issues.