Pressing space will toggle the main thrusters on and off but holding S will fire the braking thrusters - that might be what's making you move backwards. In the minimap the front of the ship is the end without two spikes if that helps!
We're glad you had fun anyway!