Ugh, yeah you are right. I was able to replicate that bug. 3 trinkets are affected by it.
Thank you for the report! While looking into it I also found a flaw in existing equip-uneqip code. :)