The back/cancel button ( keyboard button 'X' or Gamepad 'button 2') will erase the "Player" on the naming screen. You can't rename yourself once you choose your name.