IIRC the wall in question only causes hallucination (the status effect that's bringing daemons) when attacked in melee. They can be safely killed with ranged attacks.