Winning fights raises it as does being a bully. I did get scolded by the occult club girl for fighting too much, so apparently there's an impact to your character for doing so and it's being tracked by the game. Never mind they were all self defense. (I think, the English translation is absolutely horrible)