Thanks for the feedback and for playing! ^^
Did you notice that the numbers sometimes have "shields" that need to be broken before you can select them? Looking back, I probably should've added a clearer response when breaking a shield.
If the issue is not that, then it might be a bug I'm not aware of, yet!