Honestly the overall collision, there was a spot where you were supposed to go up some stairs but the collisions made it really difficult. Besides the issues with the collisions the idea of having them all around the player makes it more like the player is just running into the collisions to find an opening, if you look into leading lines it could help. Take a field for example with a stone pathway, the path is very clear to the player. Now remove the path and add invisible walls all around the player without indicators telling them which direction to go, it then becomes really hard for the player to understand where they're supposed to go