Goblin warriors fought bravely, but villagers are without number (ºΔº)
Since player is the swarm, I would suggest giving goblins stronger regular units to part/penetrate the swarm.
And champion/king could have some skill to do high percentage damage (e.g. king save progress and can wipe out swarm for a few times).