You will get alternative dialogue and won't progress through the story until you talk to them again and say yes.
Mannnnn
