On ladders, you need to press the jump controls multiple times — a single press only makes a tiny hop.
