On the project settings there's a full-screen button. Not sure what tool you used to make this game though, some tools behave differently in full screen to others.
I don't know if it worked, but thanks for the help. I was thinking about tinkering with the project to fix it, but since the game jam is almost over, I'll take this tip as a learning experience for my next games.