Interesting concept! I've never seen this type of mechanic in a rhythm game before. I think it would be better if it had clearer indications of when you're pressing the buttons and a combo/score tracker. I also couldn't understand why some of the notes would disappear before reaching the buttons sometimes, so I agree with the tutorial level suggestion.
Regardless, cool game!