Ohh, just replayed it. I was using the arrow keys to move around, which doesn't allow me to fire vertically. For the full range of movement, I had to use the Numpad instead. Oops, I'll read the controls next time!
