The idea is unique and makes it feel like more than just a simple timing game. Being able approach the levels how you want which is nice, but the freedom also means it's hard to keep track of when to do what.
The indicators help with timing subsequent attempts, but losing them when you mess up makes failure more annoying since learning the timings is trial and error. I don't know how to fix it, maybe let the player mark timings on their own?
Still enjoyable, maybe just a bit too hard for me.