Haha, I figured out that you needed to press Space once you release the ball to make it slow down during its travel to reach the correct color.
