Everything feels really good, what I think makes the jumping so difficult or annoying at times is because you don't exactly know when the circles are gonna appear and when it's going to go into slow motion. If you play the game long enough you start to understand the pattern but it takes long enough that people might get annoyed.
If you lower time between the click and the circles it will obviously cause problems. So a possible solution could be to just increase the size of the outer ring so that it goes into slow motion the second you click the mouse but it takes longer to reach the center. You would also change it so that the outer edge still doesn't do anything if you let go immediately. So if you spam click you fall down still. Not sure if something like this would work.