I tried destroying all the buildings, but I felt that the impact on the final score was too small. For example, I did it on the fourth stage, and I got hit three times and got an A score.
Right now the only thing that counts for your final score is hits taken and time, destroying buildings doesn't contribute to it.