I suggest a few things. Fullscreen mode.
Make it so that the player cannot input while the cowbell plays.
and make it so that the rhythm bar doesnt drain while the cowbell is playing
this way, its the failure of the player that made them lose, not the inability to do anything
You can press alt + enter for fullscreen mode