Dragging from where to where. You cannot drag colors to houses infected with something else. If all the doctors are moving then there would be no one to make the delivery and naturally nothing would happen. If you are dragging a doctor that just making them relocate and it is not a command of delivery.