The honest answer to that is: I just had the idea, rushed to turn it into a playable game, and then let others decide if it's fun or not :D
You can somewhat do what you suggested in a custom game. One of the difficulty options hides nothing, so all cards stay visible. But I think this game kinda falls apart if you try to optimize playing it, so the memory aspect adds a different challenge unrelated to the optimal way to play. Without memory, I think there's barely any inherent challenge at all, and it needs an additional twist or a different scoring system to make the math more important and varied during gameplay.
Anyway, thanks for playing!