As far as I know, as of right now in this situation, no. Since you have to talk to Josef to pay off the debt in the first place. :/ I would recommend paying the debt off, then telling him to leave.