Oh, god...why? Stat raising games are my least favorite, because they make the gameplay more difficult, and make the game boring and monotonous. I understand that you want to reduce the amount of reading/writing, but you don't have to. I'm sure that your writing style is fine, and the game would be okay with more words instead of a mini game.
Having said that, at the end of the day, this is your game, and the decision is up to you. That was just my opinion.