You only get a bad ending if you attempt to get a harem.
The maids seem fine in every route however. Not entirely sure though.
