The game shows promise - I'd recommend working on the immediate player feedback first. In particular I'd remove the jitter from the player character at high framerates by changing the rigidbody's interpolation from "None" to "Interpolated" and adding a particle effect when one of the player's punches connect.
Good job, keep going for it :)