you need to have the event on day twenty to happen where the town gets attacked. You go to bernard and then Logan where he's hurt and you have to heal him then he says where the camp is. But it doesn't happen if bernard isn't cured of the fever and is still bedridden if that event is still going on the event will be postponed until after you cute bernard and then wait a day for him to cured and he thanks you. When those requirements are all met the bandits will attack the town and you get access to the camp.