I was going to let this go because I am afraid of being too critical, but I really feel the navigation is unintuitive.
If your map of the town is more accurate, then why, to go from the doctor to the sherriff's house, must we press "right" when your map would indicate that it is "up"?
(I know why, but I'll get to it later.)
The first point of frustration is that the arrows do not represent north, south, east and west, as one might initially expect.

In this example, if we are standing at point B, then to get to point A, it would be intuitive to press left or down because point A appears to be southwest of point B. However, we press "up" to get from point B to point A. I understand this is because we are moving "forward", and we must look at the direction that the sector is facing in order to then determine which arrow to press to get to a destination.
So back to the first point, there is no sector visible on the map of the town which you provided. So there is no way to know that to get from the doctor to the sherriff we press "right" instead of "up".
So I do not find navigating from his POV very intuitive, but if we continue with this anyways, there is an error here:

to get from the house to the map, we press right, despite the fact that that would be his left, because based on the direction of the sector, he is facing southeast.
so in that instance, we navigate from our POV, but in all other instances, we navigate from the character's POV. So it is inconsistent.
Also weird that I had to say three times that I was even talking about a map of the town. But I do appreciate that you have responded to my comments.