This is one of my fave games this jam. I do think having some element of 'guessing' where it goes based on the object could make it more fun.
thanks for idea and thanks for playing!