What do the reports say? The reasons could be very different: hunger (buy some food), toxicity (your slaves drank too many potions: negative effects may last for a few days), high stress (cast sedation/dream on them before the day ends), hygiene (clean the mansion and appoint someone as maid).