Really cool idea, bit hard but definitely feasible!
A cool addition could maybe be to add a clock to the game (and maybe stop it when you detect a failure) to make things easier to time once you failed