I've touched base with our team and the reason why there isn'ta leave-fishing exit button is because we ahd planned on integrating the fishing into the visual novel mechanics so that the fishing unlocks another dialogue option. We hope to integrate that into the game later.