Ok, this could be good fun, but I think it's a bit too hard. Some difficulty levels or bit less precision required might help, or I just suck at rhythm games :)
Also, that the music fully stops when you miss causes me to generally miss the next beat as well, maybe that could be less "harsh" and only cut out part of the track or lower the volume for a bit.