Affinity increases magic dmg so you only need it on blood mage
estrogen and testosteron have no battle effects but open up new dialog options, with enough estrogen talking to the well dressed man at the Inn in ToB gives you a scene. the Guys kinda weird not gonna lie.
idk if karma does anything at this point.