I think you have to beat him in combat physically (seducing him doesn't count).
Well I've got one heart. Check. And I've beat him in combat(no seduction). Check. And....nothing. Anything else I have to do?