I like the idea, and I can see what you're going for, but I got really tripped up trying to interact with things.
Maybe I just didn't figure out the control scheme? Having the monkeys deselect after issuing one order was a little frustrating. I could pretty reliably get them to pick things up, but then couldn't make them move? Even with the items that had a 1 over them. In my two games I only successfully got rid of one item. I felt like I'd started understanding it, but when I went to deal with the next one both my monkeys got stuck behind the big mug and I couldn't select either of them.
I enjoyed the music though, and the TODO list was a nice way of setting out some goals to achieve