Go to the lucky night, get the job as belly dancer, go to work and tempt the man with the head wrap, get the slaver's flame tattoo, and go talk to the man at the slave house
That's the thing, In the r52 changelog it says that I can be captured by the caravan even if I have beaten it before. Which don't seem to be able to happen to me, the caravan turns around and goes away.