Thanks for downloading! It is mentioned in the controls, that you need to press right arrow key for beats coming from the right and left arrow key for beats coming from the left on time.
I probably should have mentioned or showed this in the game too to make it more evident.