Found a silly bug: if you choose neither of these options but click > instead, you'll be able to move freely and exit the location (it works everywhere when you have to choose "yes" or "no".
Found a silly bug: if you choose neither of these options but click > instead, you'll be able to move freely and exit the location (it works everywhere when you have to choose "yes" or "no".