Hmm, that shouldn't be the case.
I tested this just to make sure.
1. Used a level 0 Ally and they gained 1 XP.
2. Intentionally lost after they gained 1 XP.
3. Waited for them to show up at the Soul Creator
4. Added them to party
5. Checked EXP -> stil 1 XP.