I mean, if it's difficult, try to train up some of your stats, that what I did for a while and did win with nearly draining all of my energy and magic. You can avoid getting caught if they are charging up by guarding yourself.
