You can remove blocks with right click! (you can even hold down left/right click to place or remove multiple in one swipe)