I see the problem, I wasn't using the joystick, I was using a computer and was using my keyboard.
That being said, here is some more feedback:
Make your game more compatible with regular computers, it will make it way easier for people to play and review your game.