This has happened to me too! Visiting a side I've already visited from another angle. At first I thought it was because of how perspective shifts, but I was unable to backtrack to where I was previously. Just the t-shaped intersection on both sides. Very strange.