I assure you that you're not dumb XD I think most of it is because the rules were not explained very well :)
You're absolutely right about the seemingly unrelated grids, I think this is a big issue and I'll definitely be revising the math post-jam :)
Great feedback and thanks for playing!