For what it's worth, I finally found the cave, after playing another thirty minutes walking back and forth along the cliff face. I think it's a bit hard to tell anything is there since it's all just kinda grey, you know?
That's a fair critique, I think. Duly noted!