NPCs should usually end the dialog and start following you in any kind of "going somewhere" situation, but I will investigate adding this as a feature.
