F11 or alt-enter is fullscreen!
If it comes up surprisingly small still, you might have to go in its properties, compatibility options, and set hi-dpi mode to "application".
Also, thank you! :)