Don't fight them alone, bring Rylan. (You can have Cicero (blue lizard by doing the quest, Meta-Sith) he will become additional trooper too in fighting the Wyverns in Silent Plains. Follow the Meta Sith side quest.
Also bring Bradley. He is a tough nut when dealing with Wyverns,