There's def some missing pieces to this puzzle: such as recovery building upgrades for the guild and an expanded quartermaster system. Another key thing is that the idea will be that you will likely want to be using different exiles for different things, which will give some time to recovery. This will be reinforced by days passing by actually mattering more (no reason not to spam rest right now).
But right now it is indeed a bit slow and grindy if you stack a ton of recovery that burns VIT. Did you also know that increasing Vit makes rest more efficient? Unfortunately there not enough ways to get more max vit currently.