To me it just felt too complex, like there were too many mechanics. I do agree though that it didn't really "click" as it is. It might be worth iterating on this some more and swapping things in and out to see if you can figure out some really solid gameplay.