That is true. But Hermit is a very hard convoy to play in the first place :) It's such a specialized setup that it's pretty impossible to balance for that. But what I think could solve the problem is, when the "vitalizing systems" had a fixed number of activations. So with hermit you just need more time (a lot more maybe) but you can eventually break through. Say 2-3 triggers if they are the first boss in a run.
Thanks for reporting in!