Ego is a hidden stat that increases when you win battles and/or aggressive in them. The opposite is true if you lose battles or are passive in them you lose ego. The main (maybe only) affect I've seen it change is the penis and ball size if your character has them.