Yeah this is a weird issue. I think its a problem with RPG maker. I can set the items to be "In Battle" only, but they can still be consumed with no effect out of battle. Still looking into a potential fix