I figured it out. Full screen doesn't work if you are in the "rate random games" screen. If you open the game in a new tab, full screen will work. This seems to be the same for all the jam games.
