One thing I can suggest that may or may not work depending on how your movement is set up is to add a physics material to the walls/player with super low friction so you can slide off them better
