So it turns out I completely failed to realize that Route 1 was an area that I could go grind in instead.
there is a cave on Route 1 at the bottem left where you can mine normal gems, then you can get the silk nightwear, to get a powerful Spinarak child to grind at route 1