You don't need chests to get to the desert zone. Just beat Gabby the oni, the exit is right behind her.
