Possibly. I honestly haven't planned that far ahead yet for the exact details of how it will affect each character, but basically it will make it more difficult to work with that character in the future and they may try to sabotage you in some way within the story.