Haha I 100% felt that way when I play tested it too! And they definitely chase you to some extent (but they never change paths from previous lives).
If you’re interested, the way the enemies work is they first cycle between a chase mechanic, and a random direction mechanic. Once you die, they replay their initial paths up until they run out of instructions on their “replay tape”. After that, they go back to chase and scatter (which then lengthens their replay tape). So they do always do the same motion as previous rounds, but if you survive longer than all your previous shadows, then you will definitely get chased.
Honestly, sometimes the timing between the enemies and your shadows gets a tiny bit off, so that could cause issues too, but with limited time, I had to prioritize other bigger bugs in need of squashing!