Thanks for playing. Your cursor needs to be actually on the objects for it to register. so if it's just on the table and not on the key/phone it won't work. It's definitely easier in fullscreen mode. Thank you for the feedback though, I'll be sure to try my best to make it easier in the post-game-jam-voting patch :)
-Jhonxay Games