You can let the entire forest burn down as long as it doesn't burn the house and maybe the car. While wildfires might need to burn out, I'm hesitant to hold people's houses in higher regard than many acres of forest surrounding them.
