F11 toggles fullscreen. Try toggling several times, waiting a moment in between each time. I have that problem too and everytime I want to play I have to toggle fullscreen twice to get it to scale properly. It's just become habit now.
