That's a common problem with physics. One of the simplest solutions I love to use to fix floor collision is making the width of the floor really big, and then usually the physics system will not let you go through. 😅
Thank you for your advice, I hope it will work in Unity :D