Wow, I can't imagine missing the lighthouse, but it's definitely possible to reach the peak without doing all the other stuff. Having no way to point the camera is also a factor in missing things.
Did you find the tiny island with the gal selling sun hats? (I'm guessing you found the not-quite-tiny island with the smaller peak.)