It seems like you level up really slow compared to how fast the lair is destroyed, at least on my end? I got to about wave 5 before 2 humans approached and my left click didn't recharge fast enough, my health was gone in seconds.
Yeah, they can destroy the shack way too fast. I'm working on an update to address this.