Could the factory be destroyed？
Yes, in a multitude of ways, when your factory is destroyed, you could probably guess that is a no no, therefore you are going to need turrets for your base and units camping the enemy spawn like this 👇 There's nothing wrong with doing it though, every multiplayer survival server I've joined had a bunch of high tier units camping them lol.