Make sure you took the armour to the Wizard at the Inn. He'll install some charms on it so you can now go to the desert in the north.
You might want to check in with the guy who gave you the armour as well, he'll give you some tips to help desert exploration.
You've still got plenty of game left. Good luck!