It's not a wall, it's a tower! There's another 2 souls in the graveyard, talk to the people in the house left of the Fish Statue for clues. You need to jump on one of the pole things to get all the way to the left to the Lumberjack's house, and access the cave and tower from there. Lumberjack also has clues about another ghost.