If I remember correctly I bought some materials from the orc merchant but once I built the house all the materials that should have been left over were gone.
