Yeah I guess that's a choice
Well I guess I should consider that an epic fail on my part in a funny way
I'm pretty sure you can select stones that don't make a spell, then press Go to clear them. This is typically a waste of mana, but I think you can do it to make room for new stones. I've done this with soul stones just to gain life.
