This might happen if you pursue too many different people. Does it work if you pick only one of the other characters for all the activities?