Hey, actually figured it out. There is indeed a bug for me where it only unlocks the SECOND time you exit to the world map through the Slime Queen boss area. And since I usually only left it once per playthrough, I didn't unlock it.
