Cool idea! It was kind of tough to manage the ball and the beat at the same time, and I ended up just putting stuff on the beats and hoping for the best.
I definitely see what you mean - I had hoped that you could perhaps try to time the drum beats based on previous failed attempts, but I think the physics and timing might need a bit more tweaking for that. Thanks for the feedback :)