I just tried doing this, but it just seemingly swapped between window and fullscreen. Alt tabbing still resulted in a black screen delay, unfortunately...
Of course, it's not the end of the world or game breaking, it's just a bit annoying that I can't seamlessly swap between windows. Hope this option gets added in a future update.
As I had mentioned, it's definitely possible, because that's how I play the game. It might be an option you need to toggle on, but it's not labelled as expected. I genuinely can't remember what I did to do it back then, but I've never had to change it, even through updates. I wish I had an answer.
I'll look into my settings and see.