There's some secret hacks: Set your familiars destination to something ambiguous, that way you can never be sure if it's the right place to leave them. Or their destination could be part of a set like "Every pub in town" to extend your quest.
Thank you for your kind words.