There's something where when you go to an individual NPCs page you can click a 'move' button. And that can move them. There's also a button to assign current NPC group (servant page summary of 8) to the follower page (4). BUT it seems its incomplete. I've asked about this and haven't gotten an answer. Like you can assign the current group of 4 combat followers. But it needs an interaction button there so you can still intract with them if you have different npcs on that summary page of the 8 servants group (that has interact buttons). I can't see how to go intereact with a 2nd page of the NPCs (recruited) page and how to flip through them either, either for the work npcs that work for you or for the combat group of 4 followers page. Without that working right the game gets unplayable... :S
And nobody will answer me on it either.