The map is not procedurally generated. The map in the jam entry is always the same. Use watchtowers to expand your area and you will find gold eventually :)
Ahhh Okay! I understand now! For some reason I was putting watchtowers around the crystal. I thought they shot ghosts or spotted monsters.