I’d say that if the story to a Visual Novel calls for a combat system… it could make sense. I think that the art style and UI style of the combat system looking cohesive with the rest of the game can help, too.
Okay, I'm actually having doubts because I'd generally like to see something like that, but I understand that for some people that's what makes it a visual novel, so I think it's important to know the opinion of people more involved in the genre.