I was going to comments something about the controls feeling sluggish, but then I thought about the title of your game and had another go at it. I focused on moving only on the beats and I had a better experience. Was this limitation intentional? If so, I needed more obvious instruction before the game starts.
Also, the loading screens slow down the fun. Eliminate them if you can so we can get another run in right away.