Make sure to sleep often enough to replenish your health and stamina.
ill have full health and energy and without fail on 4/5 they will come in and reset me