When your giant is facing a building, you should see an action icon appear at the bottom of your screen with a fist icon indicating "punch". Punch a building several times to break it.
