This minigame unintuitively triggers on release of the mouse button. Not when you first click it. It becomes much easier when you click and hold, then release at the right time.
