You're likely well beyond -100, so it would take a lot of submitting to get back over that.
A simpler solution is to make a few love potions and throw them at the bandits during battle. It only works on humans like bandits, so it's not a solution for other enemies currently.