There's a secret way to get back in once the door closes. If you go to the temple late at night you should be able to get a book that will help you with that
I'll give it a try and see what happens, thanks!