I really like the concept! The fast decision making is hard but it's satisfying when you get it.
I found I had to keep checking my number and the target and taking my eyes off the action... I wonder if you could display the current number on the player character itself so there are fewer places to look.