Thanks for clarifying! So, essentially, DEF buff is a field effect, but SPD buff/debuff and ATK buff are character effect.
The only character-specific (de)buffs are heavy (=slower, less movement range) and light (=faster, increased movement range), everything else is a field effect, including ATK & DEF buffs.
