Fortunately one already exists! Just select the menu in the top left and then the "leave" option. Sorry it wasn't obvious! :)
Also, you might find that the arrow keys are easier to use than dragging on desktop/laptop ;)
