I hope everyone in had a good lunch or is busy finishing up an excellent lunch. Im joined with two Close Friends of mine. And im probably the only person who can say this in the entire world. I work with and for both of them. I want to make sure i disclose my conflict of interest to start with. So general shana han went to michigan. Go blue. Rotc. Entered the service of our country in 1984. Hes been promoted a ga zillon times. Hes been promoted on a whole bunch of activities and eventually we needed somebody operationally to implement ai and he was the perfect choids. I worked with him in my role as chairman of that. Kent walker was a federal prosecutor. Law and order federal prosecutor who then chose to come to Silicon Valley and i think worked at ebay for awhile. We being google snagged him maybe 15 years ago. Coming on. Every day together. And during that time, not only did he set up our Legal Function but hes now in charge of all of global policy, pr, all those sorts of things together. So very, very significant players. And what i thought we should do since you all have heard from me plenty is simply start and perhaps, kent, we should have you make some comments about the world as you see it today. Sure. So thank you very much. General shanahan its a pleasure to be with all of you. The topic of todays panel, private Public Partnerships is extraordinarily important to me. I grew up in this community. My father was in the service for 24 years. I was born and spent my life on u. S. Military bases. My father fin ishtd his career at lockheed. I feel a pro found commitment to getting this right. I want to make sure the defense sector, private sector and universities can Work Together in the best possible way. I wanted to take on two issues up front. Its been frustrating to hear of concerns around our commitment to National Security and defense. And so i want to set the record stlat on two issues. First on china. In 2010 you may remember that google was public, an attack on our infrastructure that originated in china. Sophisticated Cyber Security attack. We learned a lot from that experience. And while a number of our Peer Companies have significant commercial and ai operations in china, we have chosen to scope our operations there carefully. Our focus is on adver tidesing and work supporting an open source platform. Second with regard to the more general question of National Security and our engagement in the maeven project, it is an area where its right that we decided to press the reset button until we had an opportunity to develop our own set of ai principles, internal standards and review processes. But that was the decision focused on a discreet contract, not a broader statement about our willingness or history of working with the department of defense and National Security administration. We continue to do that, are committed to doing that. That work builds on National Security generally. Its important to remember that the mystery of the valley in large measure builds on Government Technology to radar to the internet to gps to some of the work on Autonomous Vehicles and personal assistance that youre seeing now. Just in the last few weekends we had an accomplishment which moved forward the science of technology. That was not achievement by google alone. It built on research that had been done at the universe tooty of california in sant barb rae, benefited with Research Scientists at nasa, carried out on Super Computers from the department of energy. Those kinds of exchanges and collaborations are really key to what has made america technological innovation as successful as its been. And just as we feel as though were contributing to the defense community, National Security community, a lot of that work, that community is a part of google. We have lots of vets who work at google. We go above and beyond to make sure the reserve efrts working at google can complete their military service while having thriving careers. We try to headache sure vets transition to civilian life and can make the best use of their military skills in the private sector. We also are fully engaged in a wide variety of work with different agencies. With jake we are working on a number of initiatives from cybersecurity to health care to business automation. With daurpa we are wog working on a number of projects to ensure the robustness of ai, identify deep fakes and progress the end of moores law and Progress Software and hardware interfaces. As we take on those kinds of things, were eager to do more. We are pursuing actively additional certifications that will allow us to more fully engage across a range of these different topic areas. We think thats extremely important. We think theres a Great Partnership to have had on the dib has announced last week, their ai prince plds. Which i thought were very well done. Its a thoughtful document and continues to work the groundwork that was laid by the department of defense back in i think 2012 with directive actual3009 whichd about the use of humans, the charter of the jake, the work that d. O. D. Has done with its own ai principles. In the private sector we too have been trying to drive forward. Weve not only put out principles in overlapping areas. Theres a lot in common. Safety, human judgment, accountability, explainability, fairness, are all critical areas where Different Actors in the space each have Different Things to contribute. And i think thats critically important. This is a shared responsibility to get this right. As the dib report notes, we need a global framework, approach to these issues. Endorsing the oecd work is exstrooechlly important and something we want to support. Were working together to figure out where are they complement airries. We are a proud American Company admitted to the defense of the United States our allies and the safety and security of the world. We are eager to continue this work and think about places we can Work Together to build on each others strengths. Thank you, kent. General, take us through what youre up to at the jake. So first of all let me say thanksu thanks. It is great to be here and i thank both erik and kent for the opportunity to do this. Admittedly though, i will say im a poor substitute for the joint chiefs of staff, although i say it to lower probability of growing sand bite. You get that with it. This is undoubtedly first and last time i will serve as a warmup act for dr. Henry kissinger but hang on for the main event. I not only welcome but relish the opportunity to have this broader conversation about Public Private partnerships. When you ask me to redplekt back as my two years as the director of the project maeven and about a year as the director of the jake, tls one overarching theme that continues to resonate strongly with me. Its the importance and i would say the necessarietsty of strengthening bonds between government, industry and academia. This was said this morning, you brought it up and others had also mentioned it, is this idea of this relationship should be depicted as a triangle and it should be in the form of an eek lateral one, government, academia and industry. Thats largely the form it did take beginning in the 1950s and lasting until the early part of this decade. Walter isaacson writes about in in his book. It is what really drove to Silicon Valley stood. Its not the case today. At best the size sides are no longer eek wi diss tant. You might say they are distorted or a little frayed in addition to being different lengths. The reasons are complex. Snowden, apple encryption, miss machd operating tempo and ajiblt, different business models, general mids trust between the government and industry. We started talking past each other. The task is made much more difficult today by the fact that industry is moving so much faster than the department of defense in fact the rest of government when it comes to the adoption and integration of ai. Were playing perpetual catchup. Some employees in the Tech Industry see no compelling reason to work with the department of defense. Even those who want to work with d. O. D. Which i say is far more than sometimes is portrayed, put everyone in this room in this category, we dont plak it easy for them. So i would just reinforce some of the themes that are in the security commissions report or the interim report. And that is this idea of a shared sense of responsibility about our ai future. A shared vision about the importance of trust and transparency. Our National Security depends on it. And even for those who for various reasons still view d. O. D. With suspicion or who are reluctant to accept that we are in a strategic competition with china i hope they would agree ai is a critical component of ournations prosperity and selfsufficiency. No matter where you stand on this, i submit that we can never attain the vision outlined in the commissions interim report without industry and academia with us together in an equal partnership. Theres too much at stake to do otherwise. We are in this together. Public, private partnerships are the very essence of americas success as a nation. Not only in the department of defense, but across the entire United States government. So the message we want to send today, we have to make this triangle back to what it used to be. Well, thank you, general. I think im going to ask a couple of questions to both of you. Lets start with the same to both. Kent, talk about maeven some more. Sure. I think its no secret that we came up as a consumer company. We are quickly evolving into also becoming an enterprise company. Putting a lot of resources into that. But there are different protocols and ways of engaging. As we go along, id be lying to tell you all of our employees have an identical view on issues. They dont. In some ways that debate and discussion is the its a positive as well as a negative. In many ways its in our dna but in the dna of america. You can argue that that kind of debate is americas first innovation. Look at great Research Scientists like returned fineman who was one of the leading thinkers who was a freethinking guy. We think out of that comes incredible strength. If we Work Together well we can actually have a more robust, moe resilient framework that helps build social trust as well as a framework that works for the world. As we put forward our ai principles and governing proseesses, because the principles are easy. As the dib report noetsz, the report devotes a couple of pages to the principles and a long section to the implementation. Because you quickly discover that a lot of the hard problems are when the principles conflict. Weve had debates about whether to publish a paper on lip reading. Say that again. We have had debates about whether to publish a paper on lip reading. Its a great benefit that people who are hard of hearing around the world, et cetera, but you can imagine it can be miss used for surveillance. We determined it was appropriate to publish because that was used for reel only in onetoone settings, not at a distance. But its an example of the kind of decisions we have around issues like lip reading or official recognition or other challenging questions where we have to come to terms with the reality, the tradeoffs that were making. We think theres room nor collaboration for cybersecurity, logistics, health care, many other areas where were engaged with the military. General, same question, tell us about maeven. Our intent was to go after commercial industry. Erik and the dib had told us this is where the systems exist. Our approach was a simple one. We wanted everybody in the market that was a small startup of 15 people which is one of the companys we got on contract to the biggest Internet Data cyber Cloud Companies world. One of them happened to be google. Why do we have to google with project maeven . We wanted to take the best ai talent in the world and put it against our most wicked project set. Extraordinarily difficult problem to go after. We did a successful collaboration with the google team on this. What was happening internal to the company is how that played out is a little bit of a different story. But we got all the way to the ent of the contract and we got products that we were very pleased with. It was unfortunate for even some of the software engineers, they almost felt a little bit ost rau sized because others criticized them for working with the department of defense. But day to day, we got tremendous support in maeven from google. What we found though, and this is the critique on both sides, is we lost the narrative very quickly. Part of this was about the company made a strategic decision not to be public about what they wanted to do. Our approach is willing to talk as much as the company wanted to us talk about. Wed do whatever the market would bear. We didnt want to get into operational specifics. This was a project, reconsance on a drone that had no weapons on it. It was not a weapons project. It is not. But what happened is we started hearing these wild stories and assumptions about what project maeven was and was not to the point where if you google today, no pun intended, the adjective controversial has now been inserted in front of maeven. It was not controversial to us or the team or anybody right now beyond some people who just dont like what were doing. I guess what i bring it all the way full circle, this is an interesting point ive thought a lot and im not sure everybody appreciates or agrees with me, i view what happened with google and maeven as a little bit of a canary in a coal mine. The fact that it happened when it did, weve gotten some of that out of the way. Youve heard kent talking a little bit about a reset here and how much of the company and all the other companies that we deal with want to work with the department of defense. I think thats important. It happened. It would have happened to somebody else at some point but this idea of transparency and a willingness to talk about what each side is trying to achieve may be the biggest lessons of all that i took from it. Its a real strategy that we dont wear hats anymore because i could borrow three hats and figure out which hat im wearing. With my bib hat on i can tell you when i met general shanahan the real problem is we take these exquisitely trained people and put them in front of mind numming tasks. They watch screens all day. Its a terrible waste of the human asset that the military produces. Theres a huge opportunity to try to get them to work at a higher level position. And thats why the dib recommended the maeven procedure and the joint center for ai which you both stood up and now head. Lets talk another question for both of you which has to do with ethics. Now in the middle of the kerfuffle that went on inside of google kent had the good idea of having a formal ai proposal. He drove an ethics process we produced a remarkable document now i have my google hat on which i think was quite definitive. Maybe you can talk about that. Similarly the dib produced a proposal to the military. And i believe you are the customer for the proposal we bro on military ethics. I assume both of you are in favor since kent wrote the first one and all the other companies have now copied vare yachbts of your approach. What are the consequences of these ethics things . Does it really work . Does for example does google prevent does google turn off things or stop doing things like in the last little while . I mean, how does this actually work . And same question for you, general. There are people who have claimed that the military wont operate under ethics principles. In our report we cite the rules that the military is required to operate under. I think as a general noted, having frameworks in place on both the set of principles but also the review processes and escalation opportunities is a critical part of internal and external transparency. Its right, among our prince pals weve talked about surveillance concerns. We want to make sure that the recognition tools and Image Software are deployed in appropriate ways. We want to make sure we know the scope of the project that were developing and when were licensing that for commercial uses have the sense of the direction of travel. I think thats valuable for both sides in terms of making sure expectations are clear but Building Trust internally and across society. Another example would be when it comes to general purpose apis for facial recognition where you dont know what use is going to be made. Until we develop more policy and safeguards, were going to be very cautious about proceeding in that area. Another example, when it comes to weapons, we have said this is a nascent technology. We want to be careful about ai in this area. Were not pursuing this area given our background we recognize the limits of our experience. The military is going to be deeper and have more understanding of safety implications and the like. Were going to continue to work through these. I think theres a lot of were seeing the European Commission saying theyre coming up with regulations. This will be an interesting exercise as we all pursue a Common Mission of how we build neck nol jooez. Looking at it from the d. O. D. Lens, this may be the best starting point when you talk kent mentions these areas of convergence between areas. Probably the ai principle to drive a stake in the ground, do we agree on all of these, some of these . Lets get the conversation going. The other part is i need to state the obvious, i can tell you with certainty that china and russia did not embark on a 15month process involving public hearing and discussion about the ethical, safe and lawful use of Artificial Intelligence. Theyre not and i dont expect they ever will. People may question why were doing it. Weve just embarked on this long process just to make sure we took into account all of the different voices on the ethical use of Artificial Intelligence. I would say the product thats been delivered is an excellent product shaped by a lot of people who have spent time and attention against this. Ive said this in other settings. In over 35, 35 and a half years in uniform, i have never spent as much time on the excal use question. The department of defense actually has a long and commendable history despite flaws along the way of looking at the use of emerging technologies. There are differences with Artificial Intelligence. What the dib report does, it starts with here is whats similar to every technology, here are some areas that may be different and here are some substantive differences like systems that work on their own. We have a way of looking at this no matter if its artificial gents or any other technology, history, processes, our approach, and training are in place to look at technology and how we bring in it to production. Now this this report has been presented to the secretary of defense, it is up to i get two questions now. One is what do you think about the report . Its excellent, provides the best possible starting point. Number two, what are you going to do about it . Thats complicated. We have to come up with an implementation plan. It will be department wide, taking these recommendations, putting something together through my boss as the chief information officer, and making some recommendations on how we implement this across the entire department of defense. That is not an overnight task. We now have an outstanding starting point. So nthats a wonderful flamrg for where we are. Id like to push on this. Open ai and develop technology which would allow arbitrary rewriting of texts that was sufficiently good that they became concerned and they didnt release it but only in certain models and certain researchers. A asked them. They said did anyone i said did anyone put pressure on you . They said no, we thought it was our good judgment. You said early were going to avoid the face recognition thing as a general idea because of the dangers. Where will the industry end up in this selfrestraint thing . Is it going to be a common set of principles . Is it going to have an ai ethics common being careful . How will this play out . I think you already see some efforts to work across the industry with a partnership in Artificial Intelligence to Exchange Information on some of the work being done. Its going to be an evolving question as we develop more infrastructure, about the appropriate limts, the appropriate safeguards and checks and balances, throughout a whole variety of different areas. Im hopeful that with a common groundwork, the way that we have started to lay already, were on the path to doing that. This is true of any new technology. In Communications Platform from radio to television to the internet, youve needed new regulatory infrastructures, now social con venkss about how you use these. This is powerful. We are at the early days. I think its understandable that youre seeing a va views come together but notable that youre seeing the degree of convergence youre seeing. So general, you have talked inside the spent gon about this notion of a new kind of warfare. And i think the term that you all use is algorithmic warfare. Take us through in the same sense kent talked about this new emergence thing, whats new and powerful about this in a military context with your long experience and understanding how the military frames this . Whats the language and positioning . I go back to, as we were formed and then deputy secretary of defense bob work was in the room, ill never forget, it was like yesterday, designating us, you are now formed as the team thats going to figure out how you actually field ai. Get away from the Research Piece of it which was all happening wonderfully behind the scenes. Now we needed a team focusing on the warfighter. The same he gave us the algorithmic warfare team. Its become so much easier to say. Your acronyms are going to kill me. Lets focus on why dont you tell us what it is . Were going to face a fight in the future. Were used to fighting in 20 years in a certain type of fight. We are going to be shocked by the speed, the chaos, the bloodiness and the friction of a future fight in which this will maybe be playing in micro seconds of time. How do we fight it . It has to be algorithm against algorithm. Its a bodyion youda loop. How cast can get. Remind people what that is . Kernel john boy yd, he decide id how you get through the cycle of Decision Making, it was more about the observe sevd and orient face. In the future phase, this will be happening so fast. If were trying to do this by humans against machines and the other side has them, were at an unacceptably high risk of losing that. This is a challenging one because i think part of what youre getting at in that future scenario, how are people going to be assured that our algorithms are going to work as intended and dont take on their own life. What we will fall back on, this is the starting point been is test evaluation, validation and verification. We have to do a lot more work on the front end by the time they field so we know whafz being fielded. If we think were going to be a pure human against machine, it will be human and machine on one side and the others, but the temporal dimension, this fleeting superiority that you may be facing, it might be algorithm against algorithm. To me the key question, what happens when the whole scenario is faster than human Decision Making . Because i understand the way the military works, when theres a threat in jenl people check with their superior. Theres human judgment. Its built around some number of minutes, not some number of nanoseconds. How will the military adjust its procedures to deal with this real possible threat . It wont be driven by above. The innovation will happen at the lowest level. What we have to be able to do in laces like the jake or the maeven is give people the policies and authorities to do what they need. The people that will say i have a solution, im going write a code, develop an algorithm, going to, if you give me all the things we can do that. Its the idea in that fight it will be more decentralized than a lot of people are comfortable with today. And that brings risk with it. Were talking about higher risk, consequence, but its either that or risk losing the fight. Its this idea of decentralized development, experimentation, innovation. The innovation as was described in one of the panels this morning happens at the bottom. Weve got to give them the push from above to make it succeed. In addition, there are new fronts in Cyber Security and defense. Were seeing already sort of efforts to destabilize with disinformation campaigns and the like. The more we can Work Together across a wider battlefield, the better for everybody. Kent, do you have a model for how the industry one of our themes is the industry and the government need to Work Together broadly. Obviously we have a senior general here but im referring to the government as a whole. Theres a lot more than the d. O. D. That needs ai. Do you have a model for how the industry should work with the federal, state, the d. O. D. S and so forth . Ive already talked about two important elements that the dib reports talks about. This is the notion of trying to build broad trust. The second is a need for a global framework. The third as general shanahan alluded to, is a more operational administrative question of how do we make it as easy as possible for new companies to enter into these partnerships . A lot of the research being done in Silicon Valley is not by large but small companies. Its a rich ecosystem of innovation and its challenging for a Company Google size to start to get more involved in that environment. Its doubly difficult for some of these smaller companies. We look at moderncizing procurement from the military side and congress as well to make that as quick and nimble as possible, responsive to new needs. Looking at increasing r d funding because thats been a Fertile Ground for a lot of these collaborative enterprises to move forward. Looking at human resources. There are a lot of authorities out there which authorize private sector, people to come into the government. But in practice its harder than you would think. A lot of that hard work on the ground i think is important to making this a success. For both of you, because well make recommendations that will end up in legislation a year from now, are there specific things we could do that would promote private Public Partnership . As you show know the d. O. D. Has diox, sco and a number of others have ink ew tel, the extraordinary help that daurpa has had, the sum of all of that, do you have a model of and ill ask kent the same question. Do you have specific things that would be helpful that would decrease the frictioning and increase the cohesion between small companies, large companies, the federal government, procurement, the d. O. D. . So much has started to happen over the last couple of years with places like defense digital service, diu, all what i call these beginning insurgesies to get things moving. These are each small teams of Software People inside the d. O. D. That have had an outside project in changing procedures in the air force for example and things like this. That got it started. We have to figure out how to institution lies, make that systemic. When you ask about what are the ways . Ill tell you, tachblt, bringing in talent from the outside from academia, Jill Christman whos here has time in the government, in you wera working for a startup, 25 years in the valley, this man comes in and takes a different view of what were trying to do. We need people coming in for a year or two, going back out to the outside, us putting people happen. It needs to scale to the next level to really start to understand what were each talking about. Me going out to the valley and talking to the c suite only gets so far. Its the peer to peer relationships that i think are going to be more important than anything else. I agree. We are priming the pump on a variety of really important areas, whether thats training or maodels and simulation. Another important component of this is the i. T. Modernization. It comes embedded within a larger environment of software thats oftentimes very difficult because you have to get security clearances and appropriate certification for all elements of that piece. Theres that combination of successful individual experiments and trial runs to build the familiarity of the peer to peer level, but also the systemic change. Its time to put to bed the motion that silicon wont work. We can move forward and build this collective between the public and private partnerships. Can you summarize the key message you want to offer us . Why are you here . We approach that task thoughtfully. We want to be thoughtful and make sure we have clear frameworks and transparency as we move forward. I think that is a mission that the u. S. Government and the military share and we are looking toward the future. Youre the top, youre the fellow whos going to sort of make this change happen across 3. 2 million people, 660 billion, an enormous bureaucracy. One person at a time. It was said on the Previous Panel you must have the full support of leadership from the very top to show that it is a priority for the department. Thats critical but also insufficient. You have to have the bottom up innovation, the people pushing from below. Just keep plowing ahead and with the resources and the commitment of the department behind us, i know well get there. I think its worth saying i worked with kent for 15 years. With my google hat on ill tell you i cannot be more proud of the impact hes had. Our partnership with you over the last three years, you really have moved the resources, gotten the money, gotten the attention and delivered and there was no one before you. You are that person. Thank you both very much. Thank you all
comparemela.com © 2020. All Rights Reserved.