Regarding Saffron, I was just showing up a little too early. Once if was officially night (when residents are asleep) everything was fine.
Regarding upgrading the house, where do I find Quartz? Everything else I can either craft, mine, or purchase, but I haven't seen quartz at all. Is it a level 2 crafting skill? (Still on level one so with smithing and artifice). Is it in just one spot to mine?
Sorry if you think I'm being a bit of a pest, just really like the game!