Hey NoobieWaffle,
You can exit from the first level of a dungeon but once you start going into the next levels you need to defeat the boss then smash the orb to exit. you can always opt-out by holding Triangle/Y/ESCAPE but loose your collected resources,
Hope This helps you out,
Rafi