This is pretty neat and also tricky, and a nice take on the theme. I do like the aspect of having to remember whether you're supposed to win or lose.
Some things that I think could be improved:
• Better feedback about what happened when you lost (some sort of "game over" screen that lasts more than a few frames, and somehow indicates whether you were out of time or chose the wrong thing, and what you were supposed to do)
• I think maybe having the timer as a bar instead of a number would make it easier to tell at a glance how much time you have left.
• I was going to suggest maybe having a "Start" button instead of just starting immediately and running out of time until the player does something, but after thinking about it again, I think I might like it this way.