I like the experience. It reminded me of games like Dragon's Lair, but also of some mixed reality flash games I used to play. From the UX point of view I think it may just need a little visual prompt of when you can Swipe and it will be definitely ready to go as a finished game. Well done.