I didn't mean to punish the player, just to add something like a wrong action sound with a small screen shake.
Just to make them realise that is the wrong number that they clicked. Like this the player would know that he clicked and something happen.