I was experiencing the same thing, I noticed whenever i started a game up just to test out and ensure that the portraits were working, i noticed how the same 3-7 images (depending on # of images in the main folder) were coming up. But once i started to play i rarely encountered the same image twice, so im not entirely sure how the mod pulls images either.