Semester, these three duke with some great stuff planned for next semester already. Also to nights for him being filled by cspan, so during the question part of the forum, if you would go up to one of the microphones and also hopefully state your name and your question, another reason why we ask you to stitching is because we didnt do a write up of all of the forums afterwards which you will be able to read a couple of days after the event on our website which is comp forum. Edu, and the last announcement is that this event tonight is cosponsored by radius, which is another group at mit. I am thrilled to be able to introduce these three. It is a different story than we initially thought would be here because jeff, he called me up a little past by because his daughter was puking, and as a aa father of two young kids myself i said please stay home. And so fortunately christina couch who writes a lot about technology and works with the forum is a bright journalist in her own right has agreed to fill in as a moderator. But let me introduce everyone. Noam cohen, death of the new book the know would also, that will also be a a hashtag tonigt at a think moving forward. Got to get on that. We Work Together a decade and a half ago. Ive known him ever since. He is a great guy and a brilliant journalist. He covered influence of the internet on the larger culture for the New York Times when he wrote the link by link column beginning in 2007. His first book to know what else can the rise of Silicon Valley is a political powerhouse and social wrecking ball come is an intellectual history of Silicon Valley and critically examines how its destructive culture and ideology the little civility, empathy and even democracy. It was published in october 2017 and it is available for purchase right here, and in addition to supporting open discussion we also support both bookstores and authors. So please by all means buy the book. Its a great book. We have both read and loved it. To his left is sarah watson, a Technology Critic who writes and speaks about emerging issues and intersection of technology, culture and society. Her works have appeared in the atlantic, wired, the Washington Post, slate and mother were virtues are filled with the broken cline center for internet and society at Harvard University and author of the city for digital journalism. And then to my left is chris couch. Chris couch is a science journalist who ive had also pleasure working with for several years now. Shes also the core data for the communications forum. Our own market for the intersections of technology and psychology and her bylines have appeared in Mit Technology review past company, coexist, science, friday and wired magazine. Weve also for your convenience put all of their twitter handles on the board. And without further ado i will turn it over to chris. Actually, with further ado, sorry about that. In addition to the book come with a book that jeff cowrote, ahead of the Mit Media Lab on sale called whiplash from which is also a great book. The book of those are available immediately afterwards. And no will be your design. Thank you very think you guys for all bigger group were so excited about this panel. If you like it addresses a lot of important issues. I would encourage you to buy a book, great book. So first of all i want to kick off this panel by talking about the central argument of the book, and correct me if im wrong, is really the disruption and individualism, endemic to Silicon Valley has kind of in a lot of ways the road of humanity, is that fair to say . I was thinking about the question, the premise of this get together like have lost your humanity. The clip and is that they have . The deeper answers and the person has humanity. What were talking about this happened at a think ive approached some of this on the computers that aspect of the book goes to a lot of history of Computer Science. Peoples machines and machines with people is one of the crucial mistakes or password on i think is scary so that is denying humanity of your fellow people when you think of them so individualistic leave as little data points. I think about in the introduction type but a wellknown anecdote about googles first design director who was asked to create a design for gmail window doing it and he suggested a color. Is that you can wanted he went and tested 41 different shades of blue. The one people use was with the one in which is that he resigned over these issues and to be design director at lisa bennet googles like an oxymoron. Two other human vision of what theyre doing when they were going to test it and they dont apologize because basically they say the color, the shade of loose most popular one. Its led to 200 million in additional revenue as i think that breakdown, seeing people as data points. Theyre not apologetic about it but at least that outcomes come to some extent . Can you speak to what those outcomes are. For people to not familiar with the intricacies of Silicon Valley, can you tell me about how to supplant . What i was trying to argue is there taking this ideology called libertarianism and making it seem very normal and mainstream. What do i mean by libertarianism. Regulation, the idea that we should regulate tax these or hotels taxis come all these Different Companies that we should regulate. What children see on video, nt tv. That we should regulate who can pay for political ads. Should you live in america lacks should they declare what theyre doing . Thats one part of that ideology. This tasteful regulation and this trust the government which is really the point of our society. Thats one part. The extreme idea free speech is another one. I know all these issues are complicated. We will talk but whether im coming out too strong. To me i wrote a piece in the new yorker. Com this week about an issue on the boulevard in stanford back in the 80s with the speedy limits on free speech. There was a joke group that told racist and sexist jokes. Stanford try to limit that and it was such a severe pushback from the Computer Science department, the kind of people talk about who are running Silicon Valley, that it was reversed. To me having limits on free speech is vital to having a community that is lisa. Thats another dangerous aspect of that ideology. I think theyre doing all this, i think some of it is done in good faith but i think its having horrible consequences. I wrote this book for the 2016 election, was working on it, thinking about it but what happened from that election bears out these points. The fact that the Big Companies like google, facebook and twitter are so blase about the idea that foreign companies, a foreign country could try to influence our election or that they should be disclosure was advertising, whether these powerful tools targeting people should be used by anybody to stir up anger and resentment. Jamie shows this disconnect that they are not seeing themselves as custodians of the power they had and instead exploding it exploiting it for profit or a utopian vision that supersedes other concerns. Thats the effects. I would add one thing. People ask me when i talk about the book what prompted me to do because clearly it wasnt the 2016 election. I think about how one thing was a turning point and you can look me as a hypocrite about using gmail. I remember thinking that give it gmail would have computer region email, in order to place ads for, my mom actually passed with them catch up in the time and remember thinking how whenever mention the word cancer in no because i just didnt want hey, have you thought of radiation treatment . I didnt want that. That notion like someone would be a custodian upon information, giving it for me, would you like that right to commercialize it was a think the crystallizing moment to me when i think back on it. A lot of your work is with Technology Criticism not just the psychology but the culture surrounding it. Im wondering from your perspective, do you agree with the premise that he feel about the premise i guess of the culture of the Technology World having an effect on humanity and empathy and severely . I absolutely agree with the overall premise that a lot of people have started to unpack the current applications of the way that technology is built but also the kind of assumptions and ideologies that are acted out in the technology itself. Obviously, look at the individuals who are leading these companies and coming up with these designs look at their assumptions and ideologies really do matter. I think the biggest thing for me is i like to think about this in terms of optimization. I think most Silicon Valley leaders and companies are designed around questions of optimization. Whether its the design itself, whether its getting to the Information Access and you can connecting people as efficiently as possible or connecting you to all of the worlds material goods. Those are questions of efficiency in and optimizing for profit, right . Those are kind of taken for granted as the right terms of optimization. Trying to unpack what those assumptions are is really productive starting point is it okay, what if spending more time on facebook wasnt the optimization model . What if it was a quality experience on facebook . What would that look like . How would that change the experience or the design of the platform but also what would that change about what facebook scroll in our life is . Thats the crux a lot of question i continue to ask about technology and society. I think the trick is using the terminology of the industry, optimization and waited thinking about problems and problemsolving is a productive way of sharing language and trying to get at we havent necessarily agree to the terms of optimization but theyre coming at it from a market perspective and thats a natural way for things to evolve. But we as a society, we, construct a question whether those are the terms that we agree to or not. One of the things that i thought was really well done in the book, the book addresses how many of the issues that we associate with Silicon Valley now and with a larger Technology World, issues of privacy, issues of commercialization, issues of users being assessed in ways they may not agree to, only some of the companies that are major giants currently google being the one that one of sticks outd really started with an ethos that was entirely against all of those things. Can you speak to how did we get here . I want to pick up on the way sarah mentioned was spot on. I was reading the report she wrote that she classifies critics. I can see myself in it, and i think what shes talking about is practical ways of trying to get to a better place anything in this book i was looking at the history, also kind ask Bigger Picture kind of questions. Think of the efficiency argument. Argument. Its not in the book but this idea that in the bible there is this instruction given here you should just get it one pass in harvesting it. You should go back a second time and efficiently get every little fruit and colonel you miss because part of the ecosystem of people are traveling or four people who live off this. Again, the efficiency would be like i have a form, i need to get all the content, thats what i do, im a former. Or you could say your part of us aside society and efficiently is to listen scraps be there for other people because they efficiently use. Its like thinking about the picture, the world we are trying to create. An editor sent me a tweet or so the point out Mark Zuckerberg was saying how he cared so much about this election battling, russian meddling in the election that he was going, the company was going to spend all this money to our people, thats why he mentioned in the investment call, the were prepared to lose money over. The natural, basically youre making money from the current bad situation. Thats the point, youll flip on that one. Again, deficiencies in the way their setup that are really troubling. Is that what youre asking about, the history . I didnt know these answers directly but how did we get to. That was a question is kind ask. Youll see in the book the Computer Science at account for some hacker mentality, accounts for some of these extreme ideological ideas about free speech and kind of like a diversity and hostility to outsiders. I credit or blame stands up a lot of the profitseeking. For me the stanford, the google case was a real like very lightly. Go back and read the original papers when they were developing which was an incredible invention like the Google Search engine. Everybody agreed they were standing on the shoulders of others, but they really created something that took this chaotic thing called the early west and made it coherent. It was incredible and its the reason why he became so popular. They would also explain as you described it to me, why it need to be advertising free and it needed to be in the actual academic world. It need to be a place where it was transparent picture should be these black boxes and now of course it come to accept the idea that the google algorithm at facebook algorithm are these secret think salute you know what theyre doing. Theyre constantly tinkering with it in a mysterious way. They are arguing that for that for science, very better trusting the system because theres no scrutiny. At least the way i see the story going is basically they are serious academics. Their parents were academics. Basically the end of using so much bandwidth at stanford that they were told yet to start figure out how to pay for this. To the specific question to say could stanford have said this is a great invention, will pay for. We paid for like a Nuclear Reactor in our building. Its very important for our study of our society and site to do this but they are were told you that if you got a way to do this. There are connected to stanford network with an investor like immediately before, so only it were not incorporated. A story that is told in these books is how a person would been at stanford, graduate wrote that the check for google inc. There is no googling. There. There will be. Uniate center a month later it was of google inc. And they deposited that 100,000 check and the rest is history. Maybe its a little corny, sounds like corruption. I guess you call it selling out. For them and for facebook as well with a really had some idealism. They kind of work in all of part of the computer and do not necessarily tied to become billionaires. I think in the book you see there are other characters like peter and jeff basis for bakers and thats what theyre trying to do was to figure out a way to make money. These idealistic hackers kind of led astray, thats my view anyway. Sarah, he written extensively about a coming of the Technology World has changed over time. Can you explain how has the media theobald as a tech world has evolved . Sure. So in the Research Report i did for the center for digital journalism at columbia, what are the things of time to look at was coverage from that kind of early almost breathless excitement about the Silicon Valley moment, the dot com boom and all of that kind of energy that went into covering before the amazon era, and then later in the google and facebook and others era. That kind of, starting from a very business oriented coverage model, or from a tech blogger model. And so that kind of breathless coverage moving into something a little bit more concerned with as a technology starts to intersect with a lot of things like politics and people and society, those shifting the narrative about what matters about technology and why this is change our lives and affecting our lives. I think that shipped kind of happens at a couple different points. I think 2007 or so the iphone comes out and like we all of a sudden have dramatically changed our like daytoday relationship with a computer in a pocket basically. But yet that was still in that gadget excitement phase. Then we have like a 2013ish moment which is the snowden moment and thats where everyone comes to terms with the fact that Like Technology has both good and bad uses, right . I wanted to touch on this. As this book came out. Theres the World Without end more about the Company Controlling our access to knowledge and information. And from scott galloway, the m monopolistic, market side of thing and tim wu talking about the attention merchants talking about the companies monopoly over our information and our attention. So, i think its an interesting moment right now in part because all of the books are written before the crisis hit, so, its fascinating. The writing has been on the wall for a long time and publishers seem to have acknowledged that theres a market for the books. I like to think about this and met like where is the audience and who is this for its a narrative for 2013, it was sort of an important moment. I wrote a piece earlier than that about this german politician, a young guy who petitioned to get all of his data about that tracking that was done with him, but it was again, you kind of point out in the paper that you wrote, that the breakthrough is hard, so. Its weird, theyre keeping that data and its like they get attention for a lot of Different Reasons and probably takes a lot for people to see it, so, i think that was probably. We were talking about the problem to access, right . Like who, for a journalist. Ron and id be curious to see your take on this, for a journalist to have access to the companies they have to stay on their good side to a degree and that is especially true if youre like in the Business Tech journalist covering the story. So, you know, as more kind of journal from different walks of life are also coming to terms with impact on society, the narrative starts to change, right . Yeah, no, i think thats really what youre pointing out is maybe one of the benefits of leaving that kind of gadget phase is that thats less important. There was a sense in 2007, access to the first gadget is usually important, but now were kind of beyond the gadget phase now, and the ratifications become important in a well told story, and i didnt seek out a lot of access, and i knew that that really wasnt what they were talking about and a lot of theres an incredible site called zuckerberg files where the professor at university of wisconsin milwaukee, over the privacy issue, saying so much for us, has systematically found everything that Mark Zuckerberg has said and it has access to a usually its a videotape of him, streaming of it and also the text of it, anything hes ever said since he was 19. Ive read a lot of it, i think almost all of it and likewise, and tony tweeted 100,000 times, theres more than enough about him. And peter talks about a book, an early one i thought really about what his world view and so they all had a lot of documentation and i felt like it wasnt so vital to have an interview, when i did try to interview it was often like very stenographic and not that revealing. So, i think there is an appreciation for the deeper journalism that youre talking about and thats great. I think thats what we need. It has to be supported by the institutions, publications and to be willing for them to stick their neck out and put that forward. I think specifically of the kind of amazon Workplace Environment example, like, the reactions from bezos for that piece was what are you talking about . Were fine, just to fill everybody in, the New York Times ran a pretty large piece on the inner workings of amazon employees and it really spans from very low level, all the way up to highest middle management, not all the way to the top, but they really detailed the sort of break neck work conditions of that place and ended up getting lots and lots of attention. And i felt that the response that bezos gave was really a classic libertarian response. And bezos is obviously the owner of the Washington Post and some call him a liberal, and i think he embodies a lot of what i have in the book. His response is it can nt cant be true, if they werent treated right theyd work for another company. And there cant be gender and sex discrimination because there to be arbitrage and they would take the women programmers and and the market would correct for it. Thats another theme of the book. This detachment from retalent. When you ask about their intentions, theres something seductive of the internet erases all past. Racism and sexism. Its a new world. Its an interesting anecdote, this company was proud of the carpet they had, a simple and had meritocracy on it, were proud, a meritocracy and women were walking in and saying this is offensive. Whats offensive its the best, and having that as their slogan, they were in essence saying what we have now is fair and if you arent represented here, you didnt make it, you didnt cut it and i guess that i think they took the carpet away, but it was a reeducation for him because they believe the world has been remade because its Digital World that none of that is a legacy problems that are obviously current matter. I wanted to dwell on the bezos response. Theyre in seattle. For them to have a job theyd have to up root their families and jobs and Everything Else and its not as fungible as hes making it out to be. So yeah, i mean the question is whether its on person or not. If hes a smart person and saying that, is he really not understanding it or got hung up on when we talk about biases in technology, in terms of biases in the culture of technology, underrepresentation of a number of groups of people as well as by the products themselves, whether the Computer Vision systems have a harder time detecting certain types of skin. There was an article fairly recently on women having a hard time getting prosthetics that fit because theyre largely designed by men and so many of the problems, you have a dominant group in power that you have Silicon Valley is so very much dominated by white men, and from your perspective do you see these types of issues changing . Changing over time or right now or . Now were talking about it, right . There are books coming out and there is a lot more Media Coverage on these types of things. Is that landscaping beginning to shift or we have it as a long way to go . Oh, i mean, i would say that it would require for it to change, it would require the book is fundamentally saying that these companies are antidemocratic, that they are against democracy, theyre against how do we correct in a society for to have wheelchair access and fill in every blank . Ideally we have a democracy where its not true, but ideally everyone gets to express their opinion and thats how you represent people and i was struck by amy clo klobuchar, they had facebook and google and twitter there, she was explaining, we live in a Representative Democracy and its important that we control our elections, you understand thats how we do it and thats a message we they dont have. How do you assure fairness. We have a democracy. And i remember hearing it said like the japanese internment, maybe if there had been a japaneseamerican representative, the internment of japanese americans wouldnt have happened. You need to have some political way of correcting those things. I think that fundamentally as long as theyre going to argue they can selfregulate and they are above the government, it wont change. I think im like optimistic there could be some sort of a wave election that would kind of prevent a new path, but i dont think it can be done by themselves. The idea of selfregulation is, it wont work. I dont think that so selfregulation is like 60 of the people, just people who are talking about, well, this is another problem that extends from pure selfregulation, the numbers are astronomical. And its hard for anyone to regulate themselves. If i were given free will, im sure i wouldnt be quite as fair. I do fundamentally believe in democracy and i think its scary that you get the sense and peter thiel, that hes not an outlier. Thats sort of described as a fringe character, but hes expressing the main thought that democrat i is democracy is bad. That when you have democracy you have not smart people running the wormed. And the cofounder of paypal with peter thiel, he is sort of saying he believes in regulation, but not they think its not efficient or, i think it gets down to democracy and thats important and why i wrote the book, i mean. Sara, youve written about how specifically within Technology Criticisms that that world is also in certain ways reflective of technology and that female voices, voices of minority writers have been overlooked in a systemic way. Can you talk a little about, you know, do you see that end of it changing at all . I absolutely do see that changing which is part of why i was looking at this kind of larger eco system of people writing about these things. I think certainly in the last couple of years its drastically changed which its all for the better. I think that also has put pressure on Silicon Valley to change. At the very least, speaking of like how now versus in the future, i think weve at least seen the kind of, oh, yes, we will work on diversity for hiring. Well work on, you know, thinking more about users interests than needs. And whether or not thats affected is another question. On the kind of writing side of it, i think, i was really interested in looking not just at a set of people who are like covering technology, but the rest of the people who are also contributing to a larger discourse about the role of technology in society. And so, some of that has to do with looking at a whole range of writers, not Just Technology journalists whose beat is Like Technology, but its the people who think of themselves as critics. People who are, you know, just writing an oped because their Academic Work has a direct response to, you know, the Current Issue on russia, for example. So, my interest was in trying to articulate this larger is it system of people who are contributing and a lot of that has to do with women writing blog posts about terrible things either happening at their workplace or critiquing a technology that doesnt include, you know, fitness tracking and iphone not having a menstruation tracker, and those kinds of pieces are coming from a lot of Different Directions from a lot of disciplinary backgrounds and existing in a lot of different places and obviously thats not limited to publications, but i think what is frustrating is that a majority of the kind of traditional ways and places that you would look for technology coverage, for a long time, still, were dominated by, you know, your standard texts like dude, bro. Sorry. No, i hear you and hearing the list of things and mentioning and how a woman was, she had a bad encounter with mark van dreson. And look at the coverage of t the and a lot of women are writing about that. I imagine if there were a similar kind of push going on about that, the way this works, written by women journalists. Yeah, im certainly, like, especially in this current, like in the last two months moment im hopeful. I think when you look back at what ellen powell went through with her, i think it was klein and perkens. Talking about, explaining so, ellen powell had, i guess, she was in a company, and had a Sexual Harassment issue and that kind much just got shoved under the rug, basically. But that, again, was, you know, probably two years ago at this point. She now has a book out thats all about her, you know, follow through on what to do about this kind of systemic sexism and not having an ability to have support and have people take her seriously, take her claims seriously. So and i wonder, i cant remember the guys name, google engineer. And a lot of people look at me, google, they fired this guy. James demoore. Yes, james demore and youre saying theyre libertarians and they fired this libertarian guy for really, for his like insidious ideas and what he put there. I wonder, how do you see that . cause some ways it was like a pr. James demoore for those who dont know is the author of the infamous 10page google memo, it included a pretty large critique of googles internal culture and included some information stating that women might be naturally inclined to be biologically less inclined for coding than men, so it went over super well, and he ended up getting fired and then he went on a fairly large pr push after that, saying that, you know, it was his like autism spectrum that like led him to believe this. It was. It was a speech, why is any idea i remember seeing someone on twitter saying, Charles Darwin couldnt work at google. Im sitting here saying, the problem is that google is now a company that isnt just doing program being, that would be bad enough, the computer lab being so nondiverse is bad, but this is affecting our society. So, even Charles Darwin couldnt do there are so many roles to be played at google. Its just a weird way of defining what it means to be a tech worker. Anyway, but and i mean, the interesting thing on the kind of free speech side of it was fascinating to me because it was so much i should be able to say what i think and yes, thats true and in a kind forum, but this is within the company and the company basically saying, like, well, yes you have free speech, but we can also decide to fire you. That doesnt preclude you from, you know, you dont fit in our culture anymore, which i think is fascinating that we have reached a point that google can say that thats not what their culture is or what they dont want their culture to be like. Perceived as, anyway. Sure, right. But, yeah, its still indicative of this engineering mentality of just like very transactional, like very datadriven assumption or you know, backing of an idea and saying like this is the way the world works and all of these kind of more just interventions are not valuable in his mind. I think that there is also, as far as biases within tech culture and tech products, theres a very valid argument that as technology increases, as we become more reliant on automation, on algorithms, this biases that you might once be able to hold someone responsible for hiring only men or hiring whoever, that its an algorithm thats doing it and now youre losing that person to hold somebody accountable to. Would you guys mind talking about the role of explainability and transparency might play with some of these issues . Sure, yeah, i mean, i think theres this great interest in like, okay, well let the hr algorithm system do the work and like then we have to say that its not biased because biased. Its not a human deciding, aha. Of course, what are you optimizing for. Gets back to my main question which is okay, success if youre building this algorithm to say, like, what a successful person at google looks like, then youre already baking in a lot of assumptions about their backgrounds, their history, their schooling, all of these things that continue systemic, you know, injustices, in the sense that, you know, you dont have access or you dont have the right background or you are just not a white man who gets along in his, you know, coding cohorts, so, i think there are a lot of people talking about this, especially in the kind of ai ethics and shout out to klein center and mit for working on this and accountability algorithms, saying that these are yes, they are objective and yes, they are outsourcing the decisionmaking process, but looking into what the terms are really does matter. And i think thats still a hard conversation. Yeah, i mean, i was like there was a footnote in a book that sherry wrote and i went back and looked at ai, one of the chapters about a guy named John Mccarthy, a professor at mit and moved to stanford and came up with the term ai, and he was an early Computer Science pioneer, but also ai pioneer and the whole quest to creative thinking, the idea being machine thinking as people and the brain itself is an entity that could exist outside of a body. A lot of it was really to me, very odd and revealing quest that the early pioneers had. A key scene in the book is between, a debate between John Mccarthy and this professor, mit professor whether a computer could be a judge and theyre like, theyre really very angular, argued a lot all the time, almost appeared against each other and mccarthy says of course, a computer could be a judge, it can do everything, as long as its programed correctly and why couldnt it do anything. Wisenbalm, a refugee from germany, that was an obscene idea, seek something as human, lost their humanity. As being as humane as a judge or a therapist, that it could be a computer was a disconnect with reality. And in a footnote on that, and pt it was about how she interviewed minority students at mit like in the early 80s and they were very encouraging of the idea of a judge being a program, a computerized judge because they thought, you know, we know judges are biased and horrible and the computer will be fair and at the era they believed that computers could actually be separate entities and be like a thinking being and then cut to ten years later and you know, the view entirely switches, realize that basically its being given garbage information how judges rule in reality. Whats it going to learn. How would it be different, any better than what its learning from, the Machine Learning argument. So, all a way of saying computers are neither good or bad. Its obviously the people who use them and the information theyre given. Theyre not any about thor than our society, why would they be . Again, a fiction that the computer world is different from the real world. Its a product of the world if we have a racist, sexist society, its not going to fix it, how could it. And one of the quotes that wisenbalm said, a carryover from the book, a lot of the problem, the computer programs think theyre so great at math and they should be solving all the other problems. Math is easy, at least for him it was, but solving injustice or writing a poem, thats hard. So, its that fundamental disconnect thinking youre good at programming or math that you should run in society. We know how hard it is to fix society is the fundamental problem. Do you feel that technology has any role to play in terms of correcting these issues . You know, i contradict myself, i think there was a famous well, a famous court case in the 80s which was arguing that the Death Penalty should be ruled, you know, invalid because it showed systemic bias. So obviously, i think that data and showing systemic bias can be very enlightening to the publicment so, you know, and the court ended up not using that and didnt basically said you have to prove theres racism in each case, you cant have some systemic argument that our criminal Justice System is unfair and ive proven it with data so we should fix it. On the other hand, data could enlighten us into how Unjust Society is and what we should work on fixing, but i dont think a program is going to do that. Does that make sense . Sure. Yeah, i mean, this leads into kind of a bigger question i had following up on the book. You do an amazing job kind of articulating the ideology and history where these ideas are coming from, hacker mentality butting up against the entrepreneur model. What i was wanting less and more of, okay, so what . And also, what do we do . And i kind of always go back to lawrence four points of what we do to change things. This he wrote this in code and code a long time ago. So, one of those things is, okay, we can decide what the technology is optimizing for. We can decide, you know, what terms youre designing the algorithms for or kind of what direction were leading for, and that still goes back to the question of, you know, is it optimizization towards efficiency or towards justice, right . But i think theres still other parts that we could start to unpack, like, okay, if the libertarian approach is a problem for the mentality that like this has led to huge monopoly systems, right . We can Start Talking about, you know, markets. Seems to be one of the so, lawrences has markets, codes, norms, laws are the four ways that one could or the levers that one could change society or change where things are going. Im like hesitant to say that markets seems to not be a real possibility here. Like, we have ended up in a monopoly situation, networks effects basically means that the market lever is impossible, right . Do we have an alternative to facebook . Do we have an alternative to google . Do we have an alternative to amazon, right . Kind of, yes, but not really at the scale that these companies are operating at. Which is why we kind of get back to the regulation problem, thats the law piece. Im scared because thats certainly not going to be a functional lever for the next four years, at least. You know, even looking to the Net Neutrality moment were rescinding all limitations, antitrust is still not really set to address the way that these Tech Companies are set up. It doesnt really apply to Free Services either, right . The standard ways that we look at antitrust, which are like competition, pricing, harm to the consumer, right . These kind of dont work and so, i think we have to think about other ways to hold these companies accountable, but that has to evolve into some new model thats not, you know, based on our old levers. Well, norms, i think, are something right here. Were certainly seeing what happens with less is norm kind of kicking in in a way. And i guess i am leery of the idea of code being useful because again, its not knowing what you dont know. And so, a well intentioned programmer, you may not think of the administration calendar and it isnt even its just like not, yeah, it wont be a viable solution, so, i have to say and certainly, you mention in your report, too, like the idea of what do we do now is always a big question and, you know, i think either characters in your paper who talk about how, hey, im getting the problems, solutions not my department as they say. And so, but i do i think try the arguments were making smaller, local things, the points kind of making that need to be fixed, i would think though like the power of narrative that maybe im mistaken i mean, in the book and maybe try to talk more about, is to sort of embrace sort of this individual argument and i do believe in individualism and and people, you know, selfactualizing and getting out of their lives. And the data, maybe people should have a right to their data and thats a way of framing that, that something has gone off the rails that it was considered normal for these companies to collect everything about you and even though theyre giving you services in exchange is not done a very transparent way and its fundamentally wrong. All i can fall back to are analogies, imagine if you walk into the store and follows you, oh, did you buy that . Thats interesting, ill make a dossier about you. It would be unthinkable, why . It would be a norm. People point out that like that, you know, maybe an efficient thing is to go to a store and take a penny, add a penny and 55 cents, what can i buy with this . I break a rule . I dont know, its not our norm. Its not how we behave. I think partly maybe i am hoping for a a norming away from these beliefs and a belief that we as a society, if its still possible to come together and make better rules. So, thats all i can fall back on. And have certain values like your data is yours, and partly i think libertarian ucism won t day even though you framed it with snowdesnowden, if google d have the data, and others, and they abuse that and set us on a wrong path and we have to get back from tpath. Wasnt there someone who said that facebook has better dossier on people than we do. The government doesnt have everything you bought and like and wouldnt raise your antenna. So, i think we need to try to get back our control of society, pretty openended comment, but even if thats and i totally agree with that as a direction. I still wonder, like, how does that actualize. Does that mean we stop using facebook . Does that mean we dont let facebook do certain things . Does that mean we demand certain features and protections of these companies . Does that mean we have a like collective Action Movement about like, you know, the default, or some kind of way of getting into the way to change it, right. Like, cause its one thing to say, yes, i need to have access to my data or be able to voice my interests and needs to determine the way that my news feed is filtered. We dont even get to do that. Make a Facebook Group on this right now and im with you. Does it take a movement or something. It takes a movement. I think your point, like, snowden, i think the election are going to be galvanizing moments. I was struck watching this hearing that i watched to comment about, about the Senate Judiciary hearing there was the sharpest questioner was this senator, republican from louisiana, john kennedy, who asked this pointed the best, most pointed questions whats going on. Can facebook give me a list if im an advertiser, people are depressed and could i sell them alcohol, could i, you know, know who is over weight and sell them diet pills . It should transcend petty partisan politics, i dont think it should transcend greed versus not greed. Middle america is the one hit hardest by all this. Their wealth is being taken and being sent to the coasts you know, by and large. I think theres a chance for a mome movement. If theres a belief in the political system. I think that change things are galvanizing. Even in that case, so if were going to define what our norms are, we at least have to have all of these examples and cases of saying, like, yes, this is a possible way that this advertising platform could be used and oh, by the way, we dont believe that thats an appropriate use, right . I think it has taken us a long, long time to get enough of those examples and enough of those understandings how those systems work and what theyre capable of and how advertisers are using them, for example, to even begin to establish a threshold of what we are defining as appropriate or not appropriate. And for the most part, all that have is kind of hidden. , but its heartening like the senator, i havent thought of it, i didnt articulate nearly as well as well as that. They were hemming and hawing. Very concrete, yes. It was really impressive. So, i mean, there is a sense, yeah, that maybe that is sort of more of a burden and maybe youre saying the book or the next thing i have to do is really be more concrete and more galvanizing that way. I wanted to just tell the history, like chris was saying, i just want today say how did we get here . I was genuinely baffled and i kind of came at this stuff with a lot of optimism. Wikipedia is an obsession of mean and i saw it as an incredible, arctic sum of little parts. And optimism and more trying to answer the question how did we get here, more than how can we get it back. But thats definitely the next question. Were going to have to open this up for questions in a minute. And im going to ask one last question and if anybody in the audience would like to ask a question, please go to one. Two microphones here, wed love to hear from you, because were at mit, i am 0 obligated to ask, what role does the university have for its students who are here, who are designing things, making their own startups . What ethical considerations should they be thinking of . Before moving into the real world . Wow, i mean, were kind of saying the deck is so stacked, not and to say to young people i guess, i mean, there is a well, some advocating for local, you know, there are certain tend your own garden and try to create, i would think there must be a real thrill in like trying to create a small project that can have better values, maybe not be driven by the market and seeing that come to fruition and i do think theres got to be a way to not sort of view theyre basically saying because of the monopoly of system were living in, that new companies are only looking to be acquired. And who am i say to dont seek your billions or your millions, but thats the message, try to nurture something thats smaller. I think there is a real yearning for it. And even if somebody is seeking their billions, which is weird that its thats accurate here, strikes me as very strange, what should they be thinking of before when theyre on that path . Like what questions do you feel mit students should be asking when theyre building their groundbreaking technologies . I think the hardest question to always answer, you have one intention for this technology, whatever it is that youre building, how to recognize the meyer myriad mays that the same technology could be used. And thats hard to answer until someone else has found a way to use it or monetize it or apply it to weapons or military industrial complex, right . So, i think thats probably like learning how to see your own effort from multiple angles. Like your own idea, yeah. And run it by so many different people. Thats the thing, i think, is missing from a lot of Silicon Valley. How much user testing do they do, where the user gets to tell how they feel. They do so much ab testing, does that tell my experience, my emotions all of these things. And right now theyre using the market as the only way to intent its pivoting, and they call it a pivot. There are so many assumptions in most of the way the technologies are operating and thats kind of by design, the data driven approach, we can look at what the behavioral data is and determine whats going to get to you spend more time or whats going to get you to spend more money. And that doesnt get into anything about like what my actual intentions are. So, yeah, actually talk to people. And forcing real connections instead of virtual ones would be a real way to interrogate your idea. And even, you know, Mark Zuckerberg is coming around the idea that theres more to there has to be some real basis to these relationships, otherwise i have one more thing, which is, i think so much of what were talking about is like the leadership role that, you know, these individual especially in the way that, the men who are in charge who, you know, have these ideologies, but that filters in the culture of these companies and its actually, i think its imperative to think about the more systemic contextual way that these ideas get played out and you know, how that is baked into what your your engineering goals are, your efficiency, your, like, how is your job, you know, text. Whats your performance . And having some control over those questions seems to be another way that we could like cut into, you know, the overall culture. All right. We are going to open this up to audience questions now. If you would like to ask, please use one of these microphones. Please be kind and were going to switch off from one to the other. Well start at this one over here and then next one is coming over to you. My name is nina witten here from the humanist chapter at harvard and hub at harvard square. Thank you to radius and the folks for bringing this important topic out in the open. I wanted to ask the question about the sar sara, you mentioned that technologies dont take peoples feelings into account. From an ethical experience, i believe the use of emotions like and anger, that is a proxy for hooking into the dope amine circuits and creating an experience and i think its unethical. I wonder how to bring these, you know, bring this to awareness. Slum. This, you know, this is like whiskey and cigarettes and the rest of it. Yeah, how do we regulate those kinds of things, a great question. Theres a couple of things. And one is, there are already engineers and designers who are recognizing that and that again gets back to the optimizization question, is it get you to keep scrolling through and auto refreshing and infinite feed, right . Tristan harris is one much these engineers and designers, former google person, who is working on the question of time well spent, time well spent. Io. Were designers and engineers, we can design better ways. On the addiction side of things, i really love, i think she used to be at mit and now miu, but natashas work, a book called addiction by design. And its actually about slot machines, but, of course, very relevant to the design of any technological interface and, yeah, shes clearly articulating these stems are designed to keep you in flow, keep you going, not necessarily to keep you winning, and thats kind of a really interesting look at specifically such a clear use of addiction, but people are have naturally taken that and applied it to these markets, kind of broad consumer interfaces. Hello, im elliott. Born and raised in the bay area, Silicon Valley and come from all of this stuff and theres a lot of complexity there, plenty of good things and plenty of bad things. One thing that struck me your argument of unefficiency. If you have a company to take over a market or whatever it is, and youre squeezing out people who live on the crumbs, i see also like a flip side. I can argue, you know, when you pay a medical bill, who is advocating for efficiency when you have trillions of waste in the Health Care Industry. It goes both way, theres a cost to the people you squeeze out there. If you had a tech company go through and try to completely redo health care and make it an eefficient system you might be able to save trillions of dollars, but what happened to the people who got squeezed out from that system. You cant paint it in black and white either way. Theres this tradeoff. Yeah, i would think and having universal health care is a much more important goal than either one of those things. You know, in my opinion. So, i totally agree and of course, theres a reason why these companies are successful and theyre popular because there was a need for efficiency and for hailing cars and shopping and were sort of saying it needs to have a higher gome. I think what sara is framing is really good, the idea if your goal is just to maximize profit thats not a good goal. So that could explain why you want people to be addicted to maximize profit, but not good for society. And the gleaner analysis, the pollution, the first question, these are, you know, shes mentioning Alcohol Companies and Tobacco Companies and go i having people what they wants and very popular. Its like, the way you dress these things. So i think we need tomorrow enthusiasm and creativity is vital to the society, but there has to be a larger goal or we will have a problem, we are having a problem. And i would follow up, the idea, why hasnt Silicon Valley completely disrupted the Health Care Industry yet. I think it comes down to the allergy to a highly regulated eco system, right . I mean, thats so far down the road of like we just arent going to touch that. Looking at the quantified Self Community and self devices, you know, none of those are medical devices for a reason. And those are and sorry, yeah, trackers, you know, fitbits, a lot of these Companies Like wanted to start getting into, whats the tri coder, like, let me scan your face and see if you have, like star trek like no, no, how sick you are and have a checkup, like a checkup in five seconds, right . The reason that company is kind of, you probably havent heard of it, theyve gotten so far back with fda approvals and things like that. What do you think of the blood transfusions and thats part of that culture. And you talk about you think on that level. I was thinking about the level, to me it was the idea of creating Artificial Intelligence and giving birth to yourself and not dying and detached from reality and thinking of your brain something that could be on the cloud and lives forever and thats how i view it in that context, ideology of Computer Science, how do you see the biohacking. That kind of stuff and is that medical or is that data. Certainly, but then, you know, youve got a lot of hacker types who are willing to experiment on their bodies and they theres something about thinking differently about your corporeal place in the world and whether or not thats a sacred thing or not. And thats getting deep in the weeds, but thank you so much. Thank you for the engaging decision. Im a graduate student in mechanical engineering. I grew up in india and the one thing that really struck me when once i moved here was the commitment to free speech and the protection of First Amendment that the Supreme Court has provided in this country, which is i was taken aback when you mentioned free speech as liberal value and i wonder what you mean by abuse of free speech. Of course, internet is not the best place for discussions and we all know that, but how do you think we can really maintain the spirit of the First Amendment going ahead . Right, obviously, this is something that people argue about. You could argue limiting the amount people can donate to campaign is restriction on free speech and we live currently with a Supreme Court any rich person can give as much money as possible to an election and thats their freedom. And corporations as well. And that could either be a very enlightening see, why i actually thought the russian meddling in our election is it puts lie to the argument much free speech. If you think that free speech is all of these russian or other meddlers, putting words and pictures together. Whats the problem with antagonizing people and getting them to hate each other, its just words and pictures. Theres a concensus in our country that that was a bad thing and maybe our president doesnt agree. Almost everyone agrees its bad to have a foreign country serve antagonism on our people and try to pick a winner of our election. That to be a limit on free speech in one level, but to me a totally necessary one. I totally hear you, i want people to express themselves and hard to belittle that and i understand if you live in a society if you cant do that how harmful that is. There are real coasts in essence, places like twitter are allowing incredible its in anger in certain groups and look at it in historical context. Thats how i would argue. Almost like think of it as code, think that thing called ultimate free speech is just going to, would, its the right thing to do and not recognize the actual real, real effects. And thats my view of it. I mean. Yeah, i mean, i would add especially in the twitter context, i think theyve done so much to protect free speech that they do that it hampers them from undressing very serious things and behaviors like harassment and you know, how to embed text on that kind of behavior in the system. I think theyve done a whole lot and tried to do a whole lot so far, but i think there are a lot of people who are really underwhelmed by how that gets manifest in the code and how as a user who is being harassed, like what can you do aside from blocking all of these and the scaling idea that it should be automated. If you were living in a society and picking on someone in a harsh way we would say dont do that. Youd say its my freedom to yell at one person and make them feel uncomfortable so they would run away. Wed say dont do that. Thats the fundamental when youre sort of ab tract, its my speech right. I think its dangerous. I mean, i totally hear your point point hi, im a humanities graduate student at mit and six year moderator. And piggy back on that question. You talk a lot about gaovernance and believe that the regulatory behaviors should be algorithmic controlled. But they rely on human moderation human or volunteer such as in my case. What do you see as the current place and possibly foouture potential, human or in these spaces. I naturally fall back to wikipedia, they do some human policing, but fundamentally i think it has to be human. When we talk about big, its not human scale. Theres a book called the boy kings, and a beautiful description about how the scaleability was the most important thing. Growing fast and scaleability meant you couldnt be Human Customer Service and removing people out of that and thats fundamentally wikipedia managed to grow quite big, but not billions, by using people who are very motivated to do the right thing. So, yeah, i think its kind of vital that you have to have a Human Community that will respond. I mean, i think its like vital. I think it gets back to the norms question as well, as to, you know, who is determining how norms or expressed for algorithms, or for, you know, automated platforms, right . And thats, thats a pretty hard question. So, yes, thats where the interplay between technology and humans or, you know, the filler through the algorithm, but then have a human look at it and i i kind of stand on the side of, you know, i think that were going to be working alongside of technologies and ais and whatever else for a long time and its not just going to be an either or, its going to be both. Thank you. Hi, and so, im postgraduate mit and i look at your book from the perspective of both political scientist and european, i guess, right . And we do have a slightly different standards. In a way i cannot help, but sort of want to ask you, where do you see the political system, you know, in all of this . Because ultimately i would argue that, you know, what we see in terms of cause you take sort of an individualistic sort of approach, which is valid and very interesting, but i would argue that ultimately this is about, you know, how much influence do we want to give government and how much influence do we want to have on our own and thats why we have why we have the european commission, being very explicit about the use of cookies right now. If you could elaborate on that. I do think i definitely hold up europe as a model that way. The idea of the individual marred to know, youre describing individuality because the government is protecting individuals. And in america, how dare the government protect me. And thats the catch 22, isnt it great, weve got the rules and protecting individuals. Get the government off my back, off my medicaid. People dont really appreciate what is being done on their behalf. I think thats exactly i think of, you know, the rights weve forgeten. A case in europe they have this rule that basically says i have the right to even kind of you serve youve done something wrong, youer is you serve your time. You did something 20 years ago, shunts be the first thing you see on google. Wikipedia, i remember discussing this with the executive director of wikipedia. They dont like that, theyre an encyclopedia, you commit add bank robber or declared bankruptcy 20 years ago, thats a fact, part of your biography, he it should be in there. How dare you say that couldnt be put in. I think its a reasonable regulation on recognizing how the internet is different than a newspaper or court record. In the old days, things are very there were no limits and things were published and its hard to go to the court and who declared bankruptcy. You have that effort. 20 years, declare bankruptcy and now its immediately the first thing said about you, you have to sort of bend, adapt for that and thats a different definition of free speech, you know, i think. So i would take it one step further which is, i think part of what youre getting at is like whats at stake here is the legitimacy of these companies and individuals to govern and rule us, right . Like, theyre, as institutions weve kind of opted in to living in their world and those are very different worlds from like the traditional trans national, you know, view of the world, right . And thats particularly interesting and especially when were talking about zuckerbergs aspirations, specifically to, you know, understand that he has built the largest or the beginning to be the largest community. Community, yeah. So i feel like that kind of political term, legitimacy is operative here to say like, do we sign up for this actually, are these the leaders . Are these the ideas that we believe in . And if not, what do we do about that . And my last point here is that my my hope exists on the eu and the gdpr and so what is gdpr. Its the general Data Protection regulations, which is coming out or applies in, i think, may 2018. This is Data Protection and, but the big thing here is that any company that serves citizens could potentially serve somebody visiting, or a citizen visiting the united states. So it applies blanket to basically any company, especially all of the ones were talking about if they operate and serve the u. S. Citizens. That is like the best hope for any solid regulation and i think its a kind of least common denominator situation, where, you know, in the same way that cars are manufactured to meet the highest standards, california, i think were going to see that kind of level of regulation. Obviously, its a little easier to change User Experience based on geography so thats kind of a trickier loophole element of this, but im hopeful that thats at least pushing the conversations in the right direction. Again, youre looking to germany for as the world leader as well everything, you have so many thoughts while youre talking because this is my life and all the articles you brought up and the people you named are give us all your thoughts. And i am a software engineer, and with sara, focusing on the responsibility of my field approtec and engineering and also the tech in government and how to get policy people how to understand technology and how to get technologists even a sliver of interest in whats going on over in d. C. , not only to make our government better, but also to impact policies in ways that may be both in the respect and care about. I wrote notes because i know i would just start rambling and lose my train of thought. I had on the first point of harassment, diversity in tech, there are a lot of women who have spoken out. They dont get the same kind of coverage as maybe the people in the media, but kelly elliss, ellen powell, erica baker, susan, the people who spoke out against justin when he was countless really, really brave women. I dont know how to amplify them more and get the same coverage. Not enough for them maybe women journalists. We were talking about women journalists not brave women in the field and the stories that women journalists have been writing about. So then in addition to that, something you said that stood out for me and sara talked about was this idea of both not only the Market Driving decisions, but also this idea of like utopia, youre going to connects all of these people and the world can be a beautiful place of rainbows and unicorns and the second part for me, ive been in cambridge for three months. Maybe if people stop caring about money, maybe theyll care about users. And some of the engineers students in the room probably they have a sense were here because were changing the world and googles do things that matter and drives the engineers to go there. If you talk to many of the engineers, whats the average, or annual revenue for the company. I dont know. They even put like, their ads and marketing people over in a different campus and the engineers like unlimited pot of money to go do whatever you want. So, in the world of people actually are only driven by money, maybe we can figure out what to do there. What do we 0 do when people believe that what theyre doing is so good, because were at google because well make the world a better place and were at google because theres money and power to connect the world and a teach someone in developing regions to farm to pull them deep missions, but then not any about and that for me is a much harder thing to put a finger on. Also theyre not as smart as we are. They should be over there. Thats another, part of it is seduction that, i was very, i was very struck with the argument that the computer is a close world, so that you are in such control and you can make the rules and its so clean and it all makes sense to your mind. Maybe its like unfair but i talk about zuckerberg, his First Program was again based on julius caesar. Hes doing world of conquest and realizes. Who cares waste what he did one computer . Thats fine. Is that crossing of the screen to reality . Were you drawn to programming because of that closed world were all made sense . Is that what we talked about, rainbows and unicorns, create a world that way . It so interesting to say that. I think perhaps i was drawn in by the utopia of i really can help the whole world connect with each other and all these things, and candidly studying Computer Science this is back to what center with singh. Future algorithms, how great like some of your theory classes, what is it that people, they dont touch on ethics for users, like all that is separate so that wasnt what drew me in but but i dont think its really were trained in the way we are greater for our performance at companies gears towards developing a certain way even if we have certain interest. I dont know how to fix that. Its what i think about all the time. Is it a question of actual impact . If thats what you believe you are doing, how do you know youre doing it . Like, how do you check that you doing that . I dont think most companies have with the following two of that. Theres not room for that. Once you finish one product or feature of whatever, youre on to the next thing. And, like, how much aside from using yourself do you really get to understand how its impacting users, how users use, what their expenses are. How would you get people to think about the impact of what we work on. Requires training, social science and other skills which are not what people have. Its arrogance of thinking im good at programming, good at analyzing how millwork will affect the city. Why, why would you be good at that . One final and then i will sit down. I would love for you to talk to you later about your covering this field for so long. Definitely these roles are seen as idols in the tech field. Mostly men but people who people look to as, like, people pave the way and there in the hard Computer Science field, the leaders in ai or leaders who were original writers of main algorithm for Google Search. When they say stuff, people really listen. Things they say are not usually about ethics or or users. They talk about sufficient algorithms and things like that. Perhaps there are ways that can influence the leaders that many people listen to to really, i dont know. The interesting thing doing the book i would collect each and saying how smart the other one was but insecure about their own intelligence. Is more Mark Zuckerberg a great programmer . Of course he is. John mccarthy who was the essential figure in this book was a mathematics professor at stanford and professor passed over for tenure, adult with an mit, became a computer scientist. Was brought back to stanford as a full professor. Computer science is easy. Suddenly he is a professor. No one insecure in the world of constantly but i hear you. Its like maybe and i would be the way to get some change. I have some important person like endorsement stuff, yeah. Thank you for your panel. Im a graduate student, and i had a quick question around what you mentioned, sarah pixar really think like a lot of these issues and externalities of skill came to be because of lack of Good Business models. One question, a new book about free innovation. Its like how do we think of monetizing value when you are not aiming for acquiring actually like how do we create and value what we create . And do you really think its going to become, like, decentralized blockchain eluent owns the data, or were going to go back to our tribes that are interconnected . Like, what are the scenarios you are imagining . I am european as well. There was a summit of entrepreneurship in estonia last week, there was like such a big debate around scale ups, like the startups. People were revolting against that, like young people, fewer people, everyone was like really, do we need to scale . Is that always the model of success . So that was a lot in there, but im curious what you think. Great questions. So i think that again gets to the optimization question, like, is scale the optimization question. In your account a facebook its purely about we dont know what the Business Model is. They did know what the Business Model was for a very, very long time. But the question was scale and like network effects. By the way, like well bring in sheryl sandberg, but thats another story. So yeah, i mean, i think its really hard for people to like imagine other formats, a psycho mike okay, well, you know, maybe map or, like how long have talked about that . Since it first came out and we talked about it as one possible way to disrupt facebook. It was distributed, locally hosted social Network Infrastructure to not have any centralized kind of control over information and data. Also i think some of the guys were former facebook guys, is that white . For niu . I dont know, i forget. And in similarly, but more for like a twitter model. Thats a rough description. The thing was with even thinkig about different models like blockchain, blockchain in itself like ideologically is very libertarian, right . I hadnt thought about it, like even the idea of tribes, there probably make more sense to say they are communities that belong and its okay to share. Its like im an individual in the world and where connecting like that. I would say the other thing about Business Models is that, again not to fall back on regulation of the ideas youre supposed to make ability for things that are harmful and thats what you dont pollute otherwise would be a great Business Model to chop all the trees down and pollute the river and make the most money. I think it is on us to sort of ad the cost to this so that will work. To extract the most value. From them or what they are doing . Thats the alternative. Right. I would also add, i think it might, one other leave is like the demand side of things. Even if its hard to imagine a World Without facebook and amazon and google and apple, what does it look like if we start demanding different versions of those things are different features are different ways of interacting with these companies. Thats really hard for people to get their heads around, but is probably on the way that these companies are going to change. The pessimistic view also that Company Specific and powerful that its very hard, theyre going to stop this from happening. The power, they have to lobby and such, you know, i mean the president jeff bezos owns the Washington Post. It certainly to some good things but its ominous. I think anyone watching ought to be, its an ominous thing. I think its undeniable. So the few there so entrenched is definitely a problem. Thank you. I come from the social logical perspective of having delivered mail for 30 years in california, right smack in the middle of Silicon Valley. So using the technology. Icing the houses go up, hundreds of thousands added zeros to property and people are 30 and work for google and facebook and whatever coming to these neighborhoods and by the houses, and the people get pushed out from his houses other people that are now the contract workers that help support facebook and google. If these are not just, not just the advertising people that you spoke of but the people to work in the cafeteria, the people that drive the dry cleaner cars to bring you to cling to these people so they can work 15, 20 hours a day. And none of them or apple or facebook. Even though they spend fulltime there. Yet they have to like spend more time on the internet getting drawn into say, and you pick up another shift . You cant go over 40 hours because the we might have to pay benefits. So the fact that theres a disconnect between, like the zuckerberg foundation, right now ive read an article about how theyre trying to work on this homeless problem. Well, one of the people i know that is actually homeless is somebody that lost the benefits from a job and couldnt an old has parttime, so the only value the core center of with our bet they dont have any value of the people that truly support the company, all the outside workers. I think maybe mit probably has adjunct professors but it a of persons working in the boiler room isnt mit employee and probably gets full benefits. The lack of benefits is destroying the middle class, and thats the total lack of humanity i think. Thats peculiar. At least take care of their own. Some of the societal effects but this is the immediate backyard. Its really staggering. I think the most common argument they make is our core business is not the cafeteria and cleaning. Like, that we as these companies are going to do only our core business, and like thats the business you talking about earlier. The business my niece work for start up company. She had it to travel to paris and state in a room with five other guys wish you sexually assaulted by one of them but this was before the company had a Pr Department or an h. R. Department, sorry, and h. R. Department are you going with were. A lot of the start its a very rogue and get the dont understand how it is to value everyone around them. Think about the logic its a its not part of our core business. Its like how are you having food . How all the halls being cleaned . In the book i talk about, theres a philosopher who argued basically libertarianism is antifeminist by definition. Its not a coincidence its all text brose. Because what is individual come from . Its face of fiction you can be a google employee of the food shows up magically. Libertarianism is the argument usual in life, you are an adult milk and you dont know any that anyone who raised you. The community that raised you. Its like i would at least agree that libertarians would make sense that he felt it was a fair Playing Field here your ideology and hard work is what you should reward. Its not a fair place. By definition its faulty logic. Its predicated on devaluing women and about the family and women and giving as here to adulthood. Your knees, is that what you said . Right. What happened to her after . She stayed with the company and really talked with who come she was in a meeting of the h. R. Department, and that person did get fired, just by conversation but she was really worried about actually losing her job, and didnt. So thats a good thing. But probably because she was really good after job and maybe he wasnt as much. But it should not happen but there were not the thing set in place. But this is one thing i think it possibly be a way to bring everybody around is, like, if all of the amazon drivers that are hired right now for the holidays, its like december 23 they went on strike, didnt take a ship. People would be like oh my gosh, what am i, you know. [inaudible] in germany on black friday nothing happened. Labor unions are the counter effect. They are our hope in that sense, true. I max. Im an undergraduate in mechanical engineering. As an engineer who is really interested in user centered design in getting into that, and in particular i design conversation had to change for different users, ive noticed a lot of the conversations tend to be stuck either in academia are these design friends were a lot of these conversations exist. Even in my capstone class a huge emphasis they put on User Experience and design is great but then you shift between the jobs people end up taking and the framework of the job the end of thinking is very start to me. I was wondering like a somebody is going into in ginning field of wanting to be a professional in this or like people all of us here as consumers, viscount we see that shift in thinking in these Larger Companies . Thats a great question. I think the best way to get in is to like to make that a business case. Like, this is going to lead to better experiences and better user like value, right . I think the question is how to speak the language and put a number on it or integrate it into the kind of way that they want to value their process and their development. I dont know. Its a tough question. I think its also just the question of finding those people in the institutions themselves, in the companies themselves who are thinking like that and have influence in those ways. Or just working outside of it, right . Like Tristan Harris leaves google to kind of advocate on a large scale to influence a bunch of desire to be asking these questions in their institutions from the bottom up, right . I think that is arguably the most effective way to cut it up the ethics from the bottom up. Thank you. Thank you guys for the work you do to bring these are important issues to light. I am a resident fellow at harvard divinity school, so shout out to the humanist chaplain overeager doesnt not a lot of us who come into these rooms but thank you for coming. I worked on tech policy in the Obama Administration so im a weird hybrid person. Worked with kathy over there. All these hybrid people over there. That is what is missing. My question is related to that. One thing i think a lot about is doing the Obama Administration we did a lot of work to bring these techies into government in part because its like if you want things to change then come join us. Im thinking about this question how to interrogate our own products, and if its even realistic to talk about having teams that are within the leadership of some of these Companies Whose job it is precisely to do that, to think about what are the effects on humanity, what is the justice lens of this stuff. Theres an element of, if thats not your job to do it, its like a frog and boiling water problem. You forget how to look at those things, or you tell yourself its easy to believe the narrative of were here and were changing the world in these ways are those ways. Even if the product may be a skanky people to education who otherwise wouldnt have. Your job is not to look at a macro level at how the Overall Company is influencing the direction of things. And so those of us who are talked about these issues, it strikes me a lot of us should talk about joining the companies themselves but i also wonder if the sound idealistic, people could be empower individuals, what would it take for Mark Zuckerberg to say yes, we want the team that doesnt this. It would be having the humility to admit that like right now theyre not doing those things. I think theyre shortly thinking about it right now, at least from a kind of oversight perspective for a bunch of Different Reasons. But maybe not quite to the level like having a chief Human Experience officer or some version of that. I think this is why its really important to not buy look at the individuals but also look at the systemic support systems around them. Like, what is the institutional org chart for facebook, right . Like that matters for google. That matter how does it change over time. Also really matters as these companies scale as they as a g, as a start touching more things. I think that is, aside from like trolling, like how do we as a public it to look into that . May be the shareholder, like has little bit of insight into that but probably not much. I think the book didnt dwell on this but a major absence is like lack of Labor Movement and that is what, there needs to be these checks. Believe me, labor unions are inefficient but they serve as a very valuable come when you see the whole of society you see labor unions being inefficient and giving that incident is. They serve this vital to check these companies. They will not do it voluntary. There will not be selfappointed are only in reaction to the bad press and the valid concern about the election. Thats leading to some change. Lack of diversity, that could lead to some change. If there are actual labor unions that would be able to strike and really affect the balance of power, the only things that i think will make them change. Its not beyond the realm of possibility that what happened but i think we expect an order charges a numbers like that, it wont have knowledge of because they think theyre doing the best. Thats why the message of the book, they think theyre doing the best job and they will say look at successful that are, that is how i know im doing a great job. Youre talking with ethics or whatever these things are. Go back to the google designer producing i have a vision for google, my vision for how it should look. Im a designer. I study this. They are like which is going to test it. People will like what we do, its like theyre not speaking the same language i would say. It doesnt compute what were talking about. That makes sense. Strikes me maybe now we are at a moment when they can no longer say we are a neutral platform and we dont need people whose job it is to think these things. But again that may be naive of me. It seems if theres a moment to push on it this may be as absolutely. I would just add, like theres any product goes through okay, lactulose have to do the check box. The lawyers are the last step to injure your sake is because its like we built all the stuff in the lawyers are saying we cant do it, or like it because its not integrated into the process. So imagine that, but like not just lawyers integrated into the process, but like experience. Who are those people and how did they get hired . This is a huge case for human what were their calculus scores . But huge case for the humanists to find jobs in these companies. Not just the engineers that we need. And last question. Youve been waiting so patiently. Thank you. My name is heather and im a lawyer, but not one of the lawyers you were talking about. And the thing that struck me is that what we study in law school largely us how the rules got there. And why we have them. And the internet seems to be a giant eraser of history and why we do things. Because i know lots of engineers, and the general mindset of engineers is we can figure out anything. And so that means that expertise is not valued. Because we can always learn it. We have all this information out here. But they are forgotten the part about that information is not helpful. And so when you have a platform that has no way for you to tell whats good information and whats bad information, you make bad decisions. In my corporations class, the first thing we studied was taxicabs here not actually the uber issue really, but more what they used to do to avoid liability was one car, one corporation, ten cents in the bank. Thats why we have the rule piercing the corporate veil. If you dont capitalize your corporation, then guess what, you dont get the benefits. We are losing all of this because we have a lot of these people who are so much smarter than everybody else, that they decided they dont need it. And they are also really young and they havent lived and they havent seen that there are reasons for why we do things a particular way. And yes, we should reexamine them periodically, but we should recognize that there is a reason. Have you ever of this thing called the id you walk into a field and you see a gate and youre just like well, it makes a sense in the middle of the field. Obviously i will just hurt down. You should at least have the politico somewhat put it there. There was probably some reason. I dont know if its the right reason but have some respect for history and context. He came at it from like a rightwing perspective, a conservative perspective. You could see why it has conservative values. Reality libertarians are talking about highly, highly radical. In a sense like the Russian Revolution or something, the lack of respect or institutions and for history in this belief that progress was the mr. Bennet happen instantaneously. I think mistakes the stakes are very high and its easy to get confused by what is being pushed forward, but its a scary, dangerous ideology and thats what i was trying to say in the book for sure. I think i would just add that, to address the kind of allergy to regulations, thats a perfect example. Theres a reason that taxis are regulated or have rules around them. This is the kind of uber model, like which is good to make it more efficient, like thats all were trying to do. So regulations on taxis and local jurisdictions dont matter. That was quite literally like the word that came out of travis mouth, but we all know where he has ended up. But all of that is to say, like, its worth acknowledging that Like Technology has politics, and like there are, you know, the libertarian stance is such that it is im just apolitical. This is efficient, this is market driven. There is no politics involved. I think what we can really push against its like yes, there are politics involved. To call it out and call a spade a spade. I was on my editor theres a line from the band rush, if you choose not to decide you still made a choice. Actually he said was pascal who said that. So maybe its more weighty that way, but thats the myth that simply do not make a decision but, in fact, they are making huge decisions. And additionally the way you ask a question, has an answer embedded in it. Absolutely. I mean, thats what you learn in legal writing. Thank you all so much for coming out, and again just this one last reminder for you go back to class. For our speakers, noams book is appear for sale. I cannot recommend highly enough. And our meeting was if youre interested in hearing about future forms is right over here. Please join me in [applause] [inaudible conversations] [inaudible conversations] heres a a look at some boos being published this week. Look for these titles in bookstores this coming week and watch for many of the authors in the near future on booktv on cspan2. Okay. Hello and welcome to great minds, the harlem renaissance at the 19th annual fall for the book library festival. I benedict carton come into department of history and art history and african studies. We appreciate your attendance. The fats of runs through saturday, october 14 for all the most uptodate information on this festival at all the other programs throughout the year plse