This happened to me and I just had to keep exploring the labyrinth, there's likely an entire section you missed which will progress things.
Big tip; an arrow pointing down does not always mean you're going back into the room you were previously.
