They say that someone in town forgot to give you a gift. I don't know who.
thats exactly what he said
Check the mansion and talk to the maid.