Thanks for following up! I should have been more specific as 'tilemap' means a lot of things in aseprite. I was talking about tilemap layers. These don't show up at all in NM inspector. You can create a tilemap layer by right clicking on an existing layer -> New -> New Tilemap Layer.
