Probably.
There are a few items that do damage but are not weapons. Or items that give block, but are not armor.
It is sometimes benefitial. And sometimes not, as with the whetstone.
There is a ring that breaks if you use a weapon, so for that one, the teddy bear sword is very usefull.