I got the stranger to leave by going to the forest the day before. I picked some herb and it made him fart. I asked him to leave.
