I had a similar experience at the start of the game. I didn't know if the game was starting, or if I was meant to do something, and sat pressing buttons and clicking the mouse to see if I was supposed to be interacting.
Then, once the opening begins, you have the same experience of just watching a movie ... but if you persevere you are rewarded with the "walking simulator" you describe, and some beautiful environments. I think you just need to get there a little faster :)