You need to be close to the door and press E, if you are using the mouse button then you are using the wrong input. That one is for picking up things :)
