Ahh! Sorry there isn't a way currently. I've just added feature to select and delete buildings on the next version but I can't upload new versions until the jam period ends this weekend! Sorry about that but rest assured this feature will directly be in the next build, along with other new stuff in v0.6!
Edit: The rating period ends next weekend, not this weekend, I mistook as I thought it's normally a week.