There's no way to delete characters when you're choosing your name, so you're always Pepper :P
There is, it's just not the backspace key because RPG Maker 2003 is a little dumb. The ESC or X keys delete characters, I'll consider making a more obvious note of that in a future patch.