Thank you for the feedback!
You are right about the hitbox. I used simplified box colliders that were slightly bigger than the visible shape of some obstacles. I'm already working on changing them into mesh colliders, which follow more closely the shape of the object. Thanks!