to reproduce:
Drag an asset into the scene with the collision checkbox enabled
CTRL+Z
Mesh is removed but the collision geometry remains