You can't indeed completely delete it, but you can "uninstall" it from your device. I don't remember how to "download" it back though..
