Oh wow, I had no idea, there aren’t any clues that there’s an upper limit on workers, I just assumed you could have as many as you wanted but that it would get harder to keep them and you had to put the effort in to find them and keep them alive :(
I’d make sure any place that mentions a crew count has /4 on the end, as well as any resource caps there might be