Edit: Removing items seems to work just fine if I leave the leaderboard name unchanged. Looking forward to the update, and thanks again!
The update was released, and your described problem shall no longer be an issue!