I think it would be a good idea for a prompt to pop up that asks if you will allow them to follow you, and if you say no then the conversation continues. At least as a temporary solution.
