I'm glad you are enjoying the game! It turns out the Jellyfish isn't the only one in the game with an eye for rocks.
You will find someone else is involved in the gem trade if you look deeper in the Moon Cottage Bed and Breakfast.
Ahhhhh THANK YOU, that's clever!