When you are moving towns, an option will pop up saying "Who do you want to move with you" and you can move an immobile partner with you
The issue is within a town. Has nothing to do with moving between towns.
