If you are being followed and leave the tile (go outside the town far enough that you load into the next loaded map area) and then return, they should no longer be following you.
this bug went away on its own, but thanks for the information