There's a lot of RNG involved in hunting! Since every location has multiple different types of people who might show up there, you can't rely on finding exactly the target you want all the time. Any particular type will get less likely as you feed on them and thus there's fewer of them around compared to the other possibilities. There are definitely more than two or three Doctors in the mix, but not an infinite supply either.