When you see that a Plant is Blocking him in on the other side, Go All the way around and Pin him, he would retreat to his home afterward.
