Hello!
The player does not have to remember their name, as a random GUID is assigned and used by every player for identification. With Unity, there are various ways you can use to save the player's name, e. g. by using PlayerPrefs or writing to a file in a persistent data storage. If you are interested in learning them, I have a tutorial on my YouTube channel which covers exactly that.