I also died to lag. I wasn't able to unlock whatever the last building is. Perhaps combining the chips in the falling animation would help? Also, knowing how many chips are in the pile vs how many the masons are carrying would be beneficial.
Great job!