If there's a plant on the stairs, you need to a specific NPC in the Elf Kingdom. She's just sitting outside the castle, on a treebranch. After talking to her, the plant on the stairs should be replaced with a plant girl, who will ask for a "green crystal".