Maybe have walls as discrete but chainable buildings? so each wall section would be like a long watchtower which you can garrison with units and they only guard that one section. If you want to extend the wall you add another section but you have to garrison the second wall separately