You do sometimes need process of elimination--there are sometimes names you can only figure out because they were mentioned and don't belong to anyone else in the scene.
