This is something kind of tricky but in the next patch there should be a change to stop them from wandering as much, and instead they should make their way back to you
Sounds cool! Thanks for the update