Not exactly sure if you can delete it, but i've heard you cane delete the goose of your desktop by pressing Esc.
