I believe he's concerned that Luna's control over them could surpass his own. For example, as far as I can recall, he can't use control on anyone under the control of the Eldritch.
