If a tile is inadvertently added to the selection, you can use Shift + Alt + Left Click to remove it from the current selection.
Thanks.
