Nice concept! As a player, I would like to feel the pace of the game increase.
Perhaps displaying the score on the screen or the speed of color change would help; or it could even be an endless roving game where in between you need to have time to get up to the right color, and then move on. In general, something that develops the game.
Anyway, good work)