I destroyed my building a few times unintentionally. You could put up a confirmation screen before actually destroying the building.
I'll see what I can do.