So, if you take more dice than your maximum, they're useless?
Yep! If you want any new dice you have to let existing ones get destroyed first.