Well, for the collider during rewinded, you should remove it if it serve no purpose.
However, if you do something more with the rewind, and it becomes useful, by all means keep it.
Right now it's not even a real "problem".
It just feels a bit weird when it moves some crates, but it isn't a big deal.