This is likely caused by this engine bug: https://github.com/godotengine/godot/issues/80173
There's a new method in 4.6 onwards that can be used to avoid the issue: https://github.com/godotengine/godot/issues/80173#issuecomment-3661005836
