I have fixed the issues actually, the problem was that my player was a capsule, when I made it a cube everything suddenly worked
See? Neverrr surrenderrr!