i believe they need to be at your mansion to not be subordinates, but i cant test that because my game is busted, sorry
