Nice idea! Good job on making the game in less than 3 hours.
As mentioned by others it's very difficult :-) Maybe with less possible colour it's would be easier (and adding more colour during after some times).
Maybe also adding a UI element to show the colour order would help, so you know how many "clicks" are needed to match the incoming enemy.