I think it's just start to decrease if you don't interact if the character
Dunno man, it also decreases after interactions, so I'm guessing affection work more like tokens?
Affection is currently currency for interactions
