You cannot remove buildings on my maps, I typically spend a lot of time to recreate the buildings on the farm and I like to keep it that way