joining the brotherhood or not is actually not an important decision in chapter 4. its if you help blake in the subway or not, seems like you got things mixed up.
