In the forest section between the caves and Gremory's lab is a little entrance blocked by rubble. After the whole lab questline is cleared, you can return there, clear the way, and find a little tree house with some fairies. After that, you should have no problems, just ask around there.