Wow! So your art is so wonderful.
I think you should consider a more significant consequence for miscounting fish or at least an alternate mode of play that adds that punishing element.
This actually reminds of me of many music games so far so I think leaning in that direction by having some sort of song play better the more fish you count correctly could be a good idea.
Looking forward to seeing where you take this!