The progress is automatically saved on your selected card. This is every time you win a cave, but there is no manual save within cave play. So you have to win an entire cave to save your progress and unlock more caves to play in.
