First: awesome idea (do you plan on doing something similar with Kol? :3).
I had some trouble figuring it out at the beginning: I thought I had to follow the rhythm given by the "How to play" and didn't get why nothing was happening, and understood how to read the colors after a few tries where nothing happened. After that, I *got* it.