I only began playing The Elder Scrolls at the original Oblivion so I'm not too familiar with that. Best case is an isometric view where you can designate plots where certain buildings go and they give bonuses to adjacent buildings, can be upgraded over time, etc. Obviously not a full fledged city builder, but hopefully a little more satisfying (and less annoying) than settlement systems in Spore, Fallout 4, Assassin's Creed 2 (kinda),
Really it all depends how much time I have for development, and seeing as Steam is rejecting this title going into Early Access due to mature content, I may need to trim things down to get it to a "1.0" state sooner.
Perhaps you could build a tavern to recruit new followers and offer a more long-term "storage" plan, but Followers aren't meant to be Pokemon--can't collect them all!