During the same event as when you rescued Ami. Just choose to keep Ard and Hana's secret and tell Morgana that they didn't know anything about Dhena's plan. They will then move into the Manor afterwards.
