Hey bud,
Thank you, I'm glad! :)
This is not currently an existing feature, but honestly a pretty worthy addition and an easy one to add. I'll look into adding it for the next alpha version.
There is however a keybinding 'Close window' that you can use to instantly close windows after captures that you could use meanwhile.
Thank you for the feedback, I'll let you know when it is added!