A cool concept, but it kinda loses its flair when you just manage to rush through the game without any "losing of control" (like, for the first few games I didn't even notice anything and thought the game was broken) :/
But still a great idea! Maybe start with randomised controls at the beginning ? :D