The Tower of Babil is a mandatory story dungeon, so just advance the story and you will be able to enter the tower automatically.
thanks!
