Take a look around the first crystal you found, you should see a ladder that goes down. Try that way.
Thanks for playing!