Thank you for your feedback!
The reason i didn't use move_and_slide() is because I used a RigidBody for player movement. It made things a lot easier to code, but now I regret using it, its the same reason why moving on the ground feels so weird. I'm really interested in going back on this game, so I definitely try to use a KinematicBody instead next time. Thanks for the advice!