In the dungeons you can click the trashcan button under the inventory to enter delete mode. Clicking items will then mark them for deletion.
There isn't a way to permanently delete items in the guild yet though.
