Quite a unique concept! At first, I was a bit confused about what to do, but once I had overcome the initial hurdle, it became quite enjoyable!
It'd be nice if all (or most of) interactions, even the wrong ones, would produce some effect on the main character instead of just moving you to the next scene (I played only the first act). It'd feel more like you're affecting the scene with your actions instead of simply searching for the correct one.
Really nice job! :)