Use the Super-Jumper skill (default key is Q) to reach higher placed bricks. Also buy some "Double interaction range" upgrades once possible to increase the distance you can pick up and build bricks at.

You can still jump up and grab them into inventory and the lag is why it happens in the first place... placing pieces reduces the load and therefore the lag so things are always worst at the start when everything falls down :) - reducing the graphics settings helps and you can put them back up towards the end if you would like to see your build in all its glory! :)

NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO

You can add them to the blacklist file in the folder where the sets are stored...