When you hold down the Space bar for a couple of seconds near a building, it gets demolished — that's part of the game mechanics. Maybe I should make it more obvious.
