Cool game, though you are right, the physics engine, or something about these RigidBodies (?), makes it a matter of luck.
Yeah, Godot's 3D physics engine isn't that great unfortunately.
