The red plus symbol gives you health, the yellow sword gives you extra damage, and the blue shield reduces your damage taken. I probably could/should have had something pop up when you beat a level telling you how much your damage/defense/health is increasing.
