Interesting concept. I eventually got stuck and couldn’t figure out what I did wrong. Check out my game, it has a similar idea :)
