I've been spamming it like QTE the whole time. There's no indication. I moved to shop, moved to area 2, spammed "pull" for a minute, moved to shop, moved to area 1. Didn't get a second fish ever. Game is not communicating its state durring fishing, or was i just so unlucky?
