Generally speaking, I don't like the idea of raising inhibitions again after they get lowered. It feels a bit weird to, say, work at a brothel and then later on being unable to because your inhibitions rose again (or worse, getting mixed reactions from the protagonist where working at the brothel is unlocked, but she is too shy to do something far less extreme elsewhere).
Still, I might add some rare exceptions to this rule, since some players seem to really want it. It's also worth mentioning that if you don't mind "cheating", you can set your inhibitions already in the travel sphere.