Don't press it immediately - the game has you start angled slightly to the right to give you more time before you have to react.
You also don't generally want to hold Z, just tap it. Because of how PICO-8 works holding it essentially will make you angle a bit then drive straight (usually into a wall).