Yep you can only climb on vines. The green biome is fully climbable, but some walls in other biomes also have vines on them you can climb.
