I'm on wave 24 now. Got there with two rare seeds in a row and 4 harvests. Enemies hit the castle anyway and armor determines how far I go. The castle reach is far and cheap enough so that the hitbox does not play into it.
Operaionally I see killing enemies and fire rate+damage only as a variable gold generator not for how far I go.