I've been getting this feedback a lot and unfortunately it kind of doesn't really match my vision for the game I guess - a more visual system would prevent people from really getting a feel of the song's beat and bpm - but I understand the frustration I guess.
The enemies do bob on the beat, though, if that helps at all. Obviously the level of difficulty I found ideal doesn't work for everyone.