You can choose specific art meshes to not be pinned to. Try to pin it to something on your model that doesn't move. Maybe the base underneath the clothing or something?
