You are supposed to use the other pieces to carry the treasure out faster and easier. But yeah, I should have incentivized that more.
