I thought it was pretty cool I too had trouble with the door but eventually got it. I appreciated the UI guidance but in the forest I hit a wall I had a feeling the key was up the watch tower? but try as I might I could not find a wat to use the ladder.
So I guess if this was where the key was that should be made more easier and if it wasnt perhaps you sould have the ladder broken to show it isn't and a perhaps a sporadic glint after x time on key for us noobs lol.