If you found the book in the library after speaking with the lady and the knight you can remove the rubble on the lower floors and decent even more.
