Yep, it's like I guessed. After you trade him 15 regular ones, he then trades for the gold ones. I just didn't have 15 regular ones till I got my farm up and running.
