You kinda can by pressing Alt+Enter. Or you can play it right here on a web page without going in fullscreen.
There was a Unity built-in settings window right at the start of a game, but for some reason when we did our build this time it was missing, and we had no time to put it back on.
So sorry, no proper windowed mode.