It's a completely optional quest. All crystals are in optional locations like Elly's quest ruins, optional puzzle in the Sand island's fertility temple, and so on. Some of them are missable, check out the scavenger camp upgrade at Quentin the quartermaster's place.
Yes, Elly has only one quest in the journal. It has several steps though.