this is actually a really cool idea that is worth exploring further. congrats!
i feel like if you make it so the player can only control the ball while it's moving would make it even more interesting and you could design some sick levels around that :)