My issue that made the loom annoying to me was, The scavenger hunt clicking all tabs to find the one new thing to clear the notification. And as you said, the notification itself is hard to just ignore.
I started out reading them, but having to spend a decent time finding the new stuff made me just want to skip reading it entirely