It seems, for me anyway, that when I press A or D I don't get points for indicating the correct answer to the glowing light or vice versa.
Edit: Nvm, I understand it now. You have to press the key before the bar fills up. It's a simple game but the concept works well. Could have used better instructions. Good work!