shouldn't it also be possible to just walk away from a box instead of pulling it
Yes, but I think that detail being "wrong" makes the puzzles more interesting