I don't think the idea works too well, not being able to move most of the time is not so good. You can pretty must just roll until you get the sword and then spin around rapidly without ever rolling again.
Also it should be visible what number you rolled in my opinion when you put it on a D20 like that.