added to the goblin bug and the not increasing army size bug, theres also a "selling and moving units in and out of army that causes the game to think you have more supply used than you do. I have 1 cannibal and its taking up 3 supply, remove it and im still taking up 1 supply with nothing in my army.
EDIT: entering a fight fixes it by creating a rat squad that didnt exist