I just had the very same question (removing patterns) and after some experimenting I found out that you can remove pattern by dragging them into the lower-right corner of the tool. Simply click and hold on an entry in the patterns list, then the delete button appears in the bottom-right and you can drag it onto that button to delete it.