The bandits will have a Morale meter after the Scar and Tank battle in the camp during the day, and if that gets below 25, they will start apearing in the tracks again until it goes above that, but you can fight any of bandits in the track area inside the camp by the Spar choice.