I was using keyboard and mouse. I saw someone else's gameplay and they used the slope of the column to launch off to the side, so I think it was more due to my wrong technique rather than controls.
I figured out why camera feels choppy. It's not due to collision. It's because camera moves and rotates at different frame rates.
See video. Camera rotation happens every 2nd frame, while movement happens on every frame.