No, but it doesn't really matter tbh. They'll run off when you rescue the real blacksmith but not with the entire inventory.
You can find the bandit later outside of the cathedral dungeon, just past the bridge and towards the back of the open field.
