Do you have any idea of what could've caused that glitch? It's fine if you only have a vague idea or don't know.
To be completely honest I don't really know how to make navigating the town accessible. Do you have any suggestions? One of my ideas was to play sounds unique to each house when the player is near them. (Like for example drinks clanking at the bar or something). Another idea was to have a dynamic soundtrack where the song would change a little depending on where you were in the town.