Yeah I thought so that it would be a little confusing if the music doesn't match up, but it was my first game jam (and first ever game too) and time was tight. So I couldn't look up or think about on how to approach that. The visual indication I had more or less implemented but removed it last minute as it looked really "ugly" and didn't fit. The timing is absolutely my fault. In hindsight I now understand what I did wrong with it technically. I agree that it should be more a little more generous.
Thank you so much for your feedback :)