Yes, you can: when asked to choose a save file, you can press Y on a gamepad or S on a QWERTY keyboard to erase the currently selected file.
