That's how it should work, casting damaging abilities reduce weapon durability just like a regular attack.
