I really like the idea of this game. I think it could certainly be expanded upon to do some really cool things.
I was unable to figure out how to know what to say to the mushroom, though I don't know if that's just me. I'd have liked to see some feedback or mechanics that helped the player make informed decisions about what to pick. It would also have been nice to have a chart of what the different colours mean, as I immediately forgot it after the first round.
Overall, an interesting, if somewhat unfinished, idea.