Thanks for your feedback!
You do have to click right at the middle of the building to demolish it. Maybe that was it?
Tried again and made it this time! It was my mistake -I pushed the D button in building mode, but to exit building mode you need to press B again! Playing the second time was also fun, and I’m glad I figured everything out!
Ah yes that makes sense
