You cannot pass a rock or a brick (if it's possible it's a bug in the game). You need to use the elevator.