I understand. You were using unity if I'm not mistook. The way the player controlled, it felt like you were using a rigidbody. However if you'd like to get a tighter feel to your game, I'd recommend using a player controller.
It'll take a little more time to figure out how, but you'll have more control over the jump arc, and the player controller doesn't have issues clipping through walls.