You use the reaping hook on the tavern sign to knock out the ogre blocking the tavern's entrance. After the ogre is knocked out, the entrance to the tavern is unlocked.
