Fun little game! I think you should turn off the rigidbody of the objects while dragging so that they dont cheat by pushing the balls with the blocks
