The damage modifiers work by adding together and then multiplying the base damage by that number. That might be why they weren't working how you thought