Just sleep then come back into the farm. (Don't sleep inside the farm).
At least, that's how I progress through
