Finding the right balance to actually pull the bricks was an experience, I ended up just pressing both mouse button at the same time so that the camera rotation would compensate the brick movement. Really neat stuff you have here, do you have any advice on how to pull the bricks without the entire structure coming along with it ?