It seems like some things got mixed up.
Yes, if you help around the farm you get stronger and at some point you have to train with Asteria because farmwork isn't enough anymore.
But you don't need strenght to fix the barns, you need to buy the upgrade on Jessica's office.
Unless I also got things mixed up, in that case I'd ask you to elaborate.