There's a teleport near the red door, on the left. That takes you to a place where you can get teleported to a new area (although one of the teleports in there takes you back to the red door).
The caves are basically Empty Clip's "water" level 😉.
