The enemies always spawn close to the player, because the map is infinite. While testing, I haven't any problems like you, but this problem will happen depending on player play style.
I will fix it.
