That's really good feedback. Based on your feedback, I have to focus on level design. I used 3 different scenes with two doors each. Unintended colliders are invisible walls and floors.
Well, thanks for the feedback.