So i've found the issue, somehow there's two colliders while the actual collider that can be registered is on the feet. I've fixed it, as for the game difficulty, i make the incoming damage is having higher tick rate but half the current damage since you probably died instantly if you getting ganged up. Cheers.