Although I keep clipping in and out of wall without the use for keys.I see a lot of potential for this game :)
Thanks for pointing out the bug. Turns out, none of the walls with windows had colliders :).