Hey thanks for letting me know about this!
I’m not sure what I intended for the behaviour here to be but this is definitely not consistent, sorry about that!
It will probably be a while before I do anything about this issue, but for now if you want to keep all pinned dice when using a saved roll; throw out another die first, it will remove only that one when you select your saved roll.