I actually equipped my own robe and was surprised to find the dwarf wearing one later one. So either a bug or I somehow accidentally added it to him, I don't know if that's possible.
For the record though I am not familiar with POE and my experience with these games is promising to play TOK someday and 20 minutes of diablo 2 remastered.