Ah, I see! The first time I alerted a guard I tried running far away rather than hiding, and this triggered more guards to chase me. That gave me the false impression that all guards were predisposed to target me whether I was actively stealing or not. Or, at least, that's how I remember it happening. :)
Now that I know the secrets I'll be unstoppable...!
... well it's progress.