If you press F or F11, it should go fullscreen. It's marked in the controls layout. You can also find that option in the options menu under Display.
