That generally only rises when you do something lewd publicly or with someone who would spread a rumor and I don't see Roghak as a gossip so it makes sense
That's why I keep hoping on a continuation of the Orc's War... but I guess we also need to wait on Zoroj's input cause his character plays a role in it as well.