It is possible, yes. But it's not very intuitive yet...
You gotta hit a building while it's crafting something to destroy it. You get all the materials you spent on it back!
I am considering ways to make this easier at the moment!
I have a question.
I always see that people break bridges with the pickaxe so they can place landfill but when i try to hit bridges to break them it doesnt work.
So my question is...
Is that a bug or what?
