I've found that refreshing the page first usually prevents the problem, but still takes up time, and only if I wait at least 10 seconds after it's finished loading.
Also probably relevant is that I'm having multiple tabs of the same site open at once. It seems that whichever tab loaded most recently is the one that works fine while the rest don't.