You can get extra stats and blade sweep from Yoru as well as traveling the forest and challenging Rin, and drinking Hikari's potions. That helped push me over,
To bath with sister the affection must be at least 50-60 affection. And harassing I think youve gotta get it up to 100 affection. The more affection you gain with any of the female characters the more access you get.