Sorry about this problem. I could not reproduce the issue on my devices. Maybe it is only on M1, M2 and M3 architecture, I'll have to acquire one. (or it could be to other external factors: encrypted disk, network drive...)
I'll soon update the audio engine, maybe this will fix it.
You are right, adding an option to pre-load sounds like it was before may be a reliable workaround, but it will be a bigger work.