After the first conversation in the hunter's hut, the game permanently loses the ability to start a conversation with the harpy again
