Glad you liked it! Initially I wasn't going to make it a rhythm game at the end, but rather an animation/music video in a similar vein to "Pipe Dream" from Animusic or "Marble Machine" by Wintergatan. However, time was low and I couldn't make anything interesting for the instrument to play so I decided to end it with a rhythm game instead.
But a more unstructured and open sandbox approach sounds really interesting! I could see it being like a 3D version of Hanenbow from Electroplankton (DS)!