interesting, fairly simple.
seems that the other materials being weakened is important for balancing reasons, but you could use the fact that the player (as opposed to the box) needs to be next to walls to break them, to create a "do this first" type constraint.
otherwise, just break all the walls.