This is already an option! It's called "Show Tile Indexes".
Not the best name. I also had no idea what it did before I clicked on it. But hey, at least it's there.
