Go to the back of the shop and have sex with the elf 10 times. Then you encounter the female swordsman. Skip to the next day and do that 3 more times. The next time, you'll fight the swordsman. In that scene, your affection meter will be almost maxed out. Defeat the female swordsman, and she'll beg you.