I've made the quest a little more straightforward with dialogue and description in the next update, but the new addition will be that the entrance is south of the shrine on the hillside, between a boulder and a tree. It's on the same map as the shrine as well