The idea for the gems was you discovered them as you explored, and to get the secret ending you had to use that knowledge to get them all in one loop. Otherwise I think it would have been tedious to explore the whole map over and over.
