I ended up going to the glory hole in the brothel with a full inventory, visiting the first whore you rescue. She gave me the whore stone but it is nowhere to be found.
