Unfortunately, unlike part 1, the controls don't work after interacting with a book until you hit Esc again.
Thanks for the heads up. I've got a fix coming soon.