Neat idea, not sure how much it fits the theme, I guess it's swapping roles with the game system itself?
Very difficult and frustrating though, it's too hard to move things quick enough to really make things happen. I also kept trying to click or move things around on the controller, even after I knew that's not how to do it. I got to about 60% boss hp.