That's fine. In the first part, there were several scenes with her that you couldn't avoid, which was annoying.
Another question: If you tell her you just want to be friends, does she still act like she's part of the harem? Because in the first part, that's basically what she did on several occasions, and it's annoying because I specifically asked to be friends so I wouldn't have her in the harem.