Once you get to the white-haired person, you can press F to start a dialogue. That seems to trigger a mushroom patch you can progress to.
