Found a glitch after visiting goblin princess and opening her affinity menu it stayed open even after leaving town.
and after sleeping the chart vanished but the crown still remains.
I don't know if that happens with other princesses couldn't test that yet but thought I report it as is for now.