distract everyone else with either sex or anything else that works, also I think if you screw with him first it gives a reason to win instead of him just using it to collect herbs.
(If that doesn't work with seducing him try it without and vice versa if you start with the other and it doesn't work.)