I found a bug!
If you evict the goose while it is dragging you around, it will continue to hold you, even when they are in the shadow realm.
Getting out of it is as easy as just clicking, but maybe this is something you could look into.