I just figured this out myself, but the thing I was missing was that the letter on the bottom of the cabin on the map represented the letter on the map im supposed to go to. I thought that was pure decoration.
Edit:is the tree with the circle on it supposed to do anything, I tried space from every direction and nothing happened.
Yes, in challenge mode. Edit: the needles from the trees, the red xs on the ground, the tree knotholes, they're environmental cues. They matter a lot more in challenge mode when misreading the environment is a lot more punishing. But you can't count the needles under a tree and say "seventeen needles means this, eighteen means that" you just need to feel it out.
