Okay, that was a bug in Ren'Py at the time of the jam deadline. I updated the engine and fullscreen seems to be working now. There's even a fullscreen button! Lemme know if you have any trouble!
Works now, thanks.