Hello,
"Dialogue sprites" have a version without armor, as seen in the "Attire" submenu and they are used for the Indoor Bath dialogues.
These will indeed be used in other dialogue, such as the ones leading to CG scenes.
However, the "Battle sprites" (fighting pose) do not have an under layer and are drawn as is.