The colored land outside the polity are the regions the polity considers part of their core regions. In theory, a polity would try expanding into those lands until it covers them fully. But it doesn't always work. Especially if the area is too big or it is already occupied by other polities. I will try to improve on that behavior on future versions.