Thanks for playing! The parry works by giving you a few seconds on invincibility after parrying right before getting hit by an attack. But it's an entirely optional mechanic.
You have a lot of health, but it doesn't regenerate so you have to use it wisely. You can see how much damage you've taken by the bullet holes that appear on the sides of the screen.