This is the very first time I’ve ever published a game, and I struggled quite a bit with the resolution, so it’s totally possible that I messed up some settings. Thanks for pointing out this issue — it’ll help me pay more attention next time :)
If you look in "edit game" near the bottom, there's some checkboxes for "add fullscreen button", that might do the trick!