I don't know if it makes me a degenerate gambler/cheater... but once I started being able to punch the other contestants I found that failing the quicktime event would actually leave them stunned for the rest of the round instead of momentarily. And yes, once I learned that I did it every round, lol.
I beat Mr Duckenson at his own game and got my freedom.