In the one room you can enter you slide against the right wall but not the left wall, this happened in my game because it was a convex polygon collision imported form blender without backface collision allowed
Damn, you got me, that's totally what happened. Thanks!
