i've gotten that too. i think it's because the game automatically moves you away from the door after interacting, and if you click on the map it interprets it as real movement at the same speed as usual, getting you way outside the map and panic teleporting you to the neares space, usually on the other side of the door