I think an in-game tutorial would have helped a lot. I really struggled to understand what to do. But I like the idea overall!
