The "get the slaver tattoo/outfit" hint was what I was looking for, thanks!
It turns out the hideout was in one of the areas I hadn't explored yet. Had explored paths around it, just not in that 3x3 area itself.