Apparently, it depends on which browser you're using. If you use Firefox, you can use full-screen mode, but with other browsers like Microsoft Edge, you're stuck with that small window. I have no idea how to fix that, but thank you for letting me know!
