Just press move towards the wall and jump. To climb higher between opposite walls, you'll need to switch move direction, like that: right+jump, left+jump, right+jump etc. That's not too hard, but requires some training.
Without learning this technique you'll skip lots of secrets (already skipped, I guess). And this game is full of secrets, 4-5 on each level.
