I would like to add that the same goes for bombs. The fact that they also push wood and stone away is a major pain in the ass.
On another note: the game as it is currently is way too much of a slog. You can get upgrades WAY too slow for it to be enjoyable to me. I'd personally increase either resource gain or upgrade cost by at least double the current amount.