There should be!
Are you playing on windows or mac?
Either way, and even if the fullscreen icon is greyed out, you should be able to switch to fullscreen from the menu bar.
I will try to implement a keyboard shortcut for this feature, btw. If I succeed, expect it in the next release - that I will hopefully upload within the next twelve hours.
Thank you! :)