I've experienced the same issues with contracts in SP. The memory leak will fix itself after 1-3 minutes of hanging and only happens when accepting harvest contracts. There is definitely a bug with the contracts that needs to be looked at.
It seems that the lag is caused by the mission vehicle spawn, I am going to experiment with changing the spawn location later.