I think I got a bug. My smelting is fully refunding my ores so I never end up going mining- unless I manually change the priorities around.
