Hate to be that guy, but the scale based on the images you have provided dont seem to be correct, like the door way seems way to narrow and tall.
its just the fov the camera setting i used for screen cap,the doors should fit in place as long the user is aligned to the grid
door fitting check -> https://streamable.com/txurzw