I don't think you can increase Charlotte's affection while she's in cat form more than 5 but if i remember right you need to catch fish but not just any type of 3 fish you need 3 D or C rank fish which are shown in Tomoe's shop, idk how exactly to get those ranks because i just fish until i get them but yeah, D or C rank if i remember right. Try that and tell me if it worked