This mainly concerns me, because I'm not using any engine.

The code for creating the window, drawing to the window, as well as the event loop are something that I would like to reuse from other projects, as rewriting them would mean nothing, since I would most likely just type the same code out.

Would this be allowed?

Feel free to reuse whatever you need to get up to the same level as someone starting on a full engine