You can close the inventory clicking again in the top left inventory button.The X slot is for you to drag and drop items to delete them.
