OH, I did a dumb. I ran into him, then reloaded as a cutscene started thinking that it was story event. Then I wandered around the dungeon and forgot all about that room. Thanks for letting me know, I'll be less stupid for any future playthroughs.
In retrospect, I should have put him before the branching paths to avoid that sort of thing. I'll keep that in mind for future games :D
