Help, need more credentials , need moreskills to survive in the current economy. Watch after words at 9 pm eastern on the tv on the cspan2. The pentagon wants to put more money into developing emerging technologies, asking congress for an additional 8 billion nextbudget year. Defense Department Intelligence officials recently talked about why they have put in the Largest Research and Development Budget request in 70 years. The our 10 minute was hosted by the armed forces indications and Electronic Association and the intelligence and National Security alliance area. Thank you. I was going to try and get you fired up here because those initial plenary sessions were a little bit subdued so i want you to feel free to get enthusiastic here. We got a great coming so lots of cheering for them and are going to have a great discussion. So welcome back. Before we jump into this next session, but he reminded everyone that for the plenary share and the maryland ballroom, you can email questions to the panel. And hopefully we will have a logo go up that says questions at intel summit. Org. So send them there. Larrys down here getting your questions and by the miracle of technology theyre going to appear on an ipad with events here area and then events if you didnt get theword at some point larry is going to tell you a last question. So its now my pleasure to introduce the moderator of our Defense Intelligence plenary. Lieutenant general vincent stewart. Us marine corps, come on. Retire. Thats the part i was waiting for. Vince is the founder and ceo of stewarts Global Solutions and International Consulting firm area general stewart retired from the Us Marine Corps in april of this year. After more than 38 years of service to the nation so join me in thanking him for his service. [applause] a career intelligence officer, vince served as 20th director of the Defense Intelligence agency where he was the first africanamerican, the first jamaican american and the first marine to hold the position of director of dia. General stewart masters degrees in National Security strategic studies from the naval war college. And in National Resource strategy from the National DefenseUniversity Area please join me in welcoming former director, good friend of industry and my friend, Vince Stewart to the stage, over to you. [applause]. The deputy undersecretary for fbi susan mike in deputy of dui jeff kruse and Trey Whitworth on the joint staff. Im going to go through quick rounds of questions. I want you to have your questions ready for followup. What i will do with the questions will give them the chance to set the stage and talk about what their highest priorities are and what their concerns are and then maybe on the back and we will ask questions that i used to get all the time. We will do kind of a table setting, several questions and then followup. We will do this kind of quick pace fast break basketball so if the question is answered and you dont like the answer we will follow up. Im going to start. Lots of conversation about ai Machine Learning and its implications for the Intelligence Community. You have described it as a pathfinder for ad Machine Learning. Can you give the audience a sense of where we are with some of the challenges you have seen and in some of the ways we can be hopeful. Thank you. Its great to be here. Thanks. I love to be here for a year. I always love the chance to talk about me than an Artificial IntelligenceMachine Learning. Right now we are in the Machine Learning phase. Wed like to get to ai but we still have quite a ways to go. Mabin is a pathfinder. When we were here two years ago we were on track within six months of the authority to proceed with the initial an imam viable product capability access field. Since that time they have scaled significantly in terms of increasing algorithm performance scaling geographic locations. My boss was at the theater a few weeks ago i got to see it in action. Where in dozens of legacy platforms and scaling across Different Missions not just motion video but other areas of intel so we are proud of that but have a tremendous amount of work to go. Just a couple of points id make on what we are learning because the key of the pathfinder is you learn and you apply that to broader act to these and something jake is undertaking get your users involved early. Its all about fielding and that minimum viable product and get that out of the field work with the users and build from there. Scale it from there. The second thing i would say is where we have learned the most on what we call the ai pipeline so writing the algorithm is the easiest part. That front Data Access Data labeling which is presently manual. Integrating it into the Weapon System and doing the accreditation of all these different systems. Those are the big areas that we are learning and now we have almost two years under her belt now. Its out there and enough capability that we need to see workloads workloads changing and we need to see efficiencies and a culture change as a result of bringing ai into the field. Thats what we are really looking for the next year. Thanks. Suzie on. Much has been said about the holding of the future and while the analytic. Craft remains the same the future will still be an inundated by growing amount of data. With all that data the analyst will have to swim their way through what is the ai doing to think through analytics and where does mars programming fit into this analytic framework . There is no question that analysts of the future is something that we are really honing in on. Clearly Mission Number number one for us is providing analytic assessments to all of our Customer Base timely accurate insightful comprehensive understanding of the information out there providing insight and ideally understanding the operational environment. You are right the Data Available to the analyst only increases by the minute. Not only that but cat printing environment that we have to assess our evolving. So the types of data and exquisiteness of that data are increasingly challenging for analyst for you named mars at the top of thelist if you will that the cia is taking to make sense of all that information deliver more insight. Mars is the one and those who may not be familiar its her effort to develop and expand the data environment which are analyst access as many more databases into one group if you will. Allows for data forces that we dont currently have and ultimately hopefully will leverage some of the Ai Technology as they mature so will allow more rapid and Creative Insight on the part of the analyst. Mars isnt it. We are doing much more in open Source Intelligence. Open Source Intelligence has been around for quite sometime but what dia is doing a structuring it so earlier this year there were decisions to establish a career path if you will for opensource collectors at dia. We are establishing an open opensource Center Putting structure among many of the efforts throughout their enterprise. The intent there is to bring increased discipline around the activities that many of our analysts and collectors are undertaking now and putting maturity and that process and ultimately allowing the analyst to leverage open doors in a much more official tradecraft compliant and useful way to so thats number two that i highlight. Finally none of this happens, none of this is effective without a strong foundation. Most people know for 25 years its been around in the has continued to evolve to meet customer demands. Demands are only increasing even outside the base. The types of things that people are using our evolving and it needs to be modernized to keep up with it. We undertaking investments and approaches. The time is now given to support mars and overall analyze the future efforts so its a top priority for us in that category as well. Im probably going to come back with a future and what it might look like. Im going to skip jeff for just a second because ive talked a little bit about the challenges of producing intelligence in a timely manner in this environment and one of the things suzanne was talking about when was the last time we used a National Intelligence estimate. This is the point of publication. You talk about the challenges of generating realtime intelligence in an estimated sort of environment. Talk about some of the challenges in the developing intelligence in this crazy world thanks for the question. The chairman of the joint staff have made it clear we need to focus on global integration which means we are not going going to become fixated on regional conflict just as a regional conflict that we are going to look it up to the we are going to look at opportunity as it applies a place of adversaries and that creates so many permutations of potential estimates. To your point when we draw what say a National Intelligence estimate or something that stays on the shelf is a 2019 edition when you are trying to get that integrated and that global presents a problem. How do you go back and fill in variables that contributed to that particular estimate with some realtime urgency once the though . Enter what we were classifying as our joint concept for intelligence operations and to your point its a spiral estimate. Its basically trying to get this going with multiple variables so that we can rest assured that at least at some juncture all of the data is being looked at but we are being cued to possibly reassess a new estimate. In case our Industry Partners didnt. Up on that static assessment Data Summaries that drive decisionmaking doesnt fit in the modern dynamic world. How does industry help us to build the very dynamic spiral estimate as the world changes and is the variables change and how do you see those different permutations so that drive decisionmaking at the policy and strategic level . Thats an area that almost any publication we put out there begins to be obsolete. How do we make that more dynamic we are going to leverage just a little bit here. There are lots of questions and comments today about computation. Jeff spent 10 years at centcom says he got to see one of the great powers carry out its strategy. Im going to ask jeff to help us characterize the challenges hes on the front end as assistant command specifically as china walks through its strategy. Ill give you an extra 30 seconds. Let me add my thanks to everybody joining us today. A great conversation. I think i would preference my conversation with china as my time at pacom with two quick stories. In 2014 in 2015 i happen to be running a for general breedlove at you, and working through what was up similar problem set. Russia was going through an evolution that a handful of operations had to be done under certain amount of cover and a question for you is how do you eliminate that and how do you convince the rest of your allies and partners or your own department of defense in this case russia presented. The second piece is way back when if you go back 10 years when i was a student at the National War College we have is very some old piece of china. It was two columns by two rows in china continuing to rise and china unable to continue the momentum in china being friendly to powers or china being an adversary. Really a decade ago no one was saying china could sustain its rise economically and domestically and internationally are militarily while still presenting a challenge to the international order. In 2016 pacom which is probably where you want me to start the story in the first piece i came to grips with all the assessments that have been made previously china had far surpassed all of those estimations that we have made. We used to rely on a handful of things about china. We had a quantitative and qualitative and experiential ability to do whatever we needed to do and go beyond. We were far more danced than other areas. Turns out china had five and sixyear plans methodically over 25 or 30 years systematically addressing all the areas where we had an advantage over the years. The first piece, my first job at pacom was illuminating and really understanding where china is in that journey that they were on and what kind of a threat it presented. The great partnerships with the National Community and it is remarkable what china was able to do in that period of time. The period of the tail end of that 18 months was the crafting of the new National Defense strategy so that really parallel back to how do we convince the rest of the department what china looks like and what are their goals and objectives Going Forward in the piece i would offer to you is that the macro level i consider china an open book. They there academics write considerably. The plan is a nation and they move out in a very large way. We know their National Objectives are to restore or achieved regional hegemony to displace the u. S. As a global power and to change some of the International Organizations out there to be more advantageous to chinas model. If we know that it becomes than what we worked on second which is the hard part what do you do about it so the peace that i would offer here is that while we used to rely on china being able to build a lot of stuff but not being able to trade with it they have worked through all of those issues and they are presenting as we have seen most recently which included not that long ago very dynamic capability to employ highend equipment against the scenario that should cause a variety of regional partners to take note of what they are attempting to do. I would say china has tried to keep their intentions below the radar script so it doesnt elicit that kind of response that we would normally take and they were certainly counting on an ability to use ties in the academic business and the community to make it challenging in decisions about what we are going to do to address that. Where we sit today in my view is a challenge for all of us is what is it that we can do today. We are in the a competition space today. China would certainly like us to take little to no action to focus on the urgent versus the longterm issues and i think what i would offer is an important piece for us is to understand the great power of competition and do well in that conflict and poster ourselves. So two, four, five, 20 years ago , cued up that way. I would like to jump on that. We have a new secretary, deputy secretary. The good thing is they have maintained all of our Department Like focus on the National Defense strategy. We arent seeing any changes there. Part is seeing china and russian modernizing the nation. Think jeff hit it on the head. We are in the strategic competition stage right now the department, we do battle well. We do force on force well away by aircraft and tanks. Its that gray zone space that we dont do as well. Its looking at that nest between economic and National Security. I think about chinas one belt one road initiative. Military planners really care about who is operating what port where. Most Missions Care about who is operating railways and we care about resilient Communication Telecom networks so all of these things are happening now and if we cant effectively be present and counter in a competitive and economic space you are setting yourself up for not being successful if and when the balloon goes up. Just another thing i would mention there is Just Technology as well as and jeff hit on this to we are seeing them in a pretty concerted effort to go after specific technologies. In the past we have been fortunate to maintain that technology in that military advantage. When you are stealing it now youll see the same technology we are doing r d on now will be on the battlefields of that technology advantage. We are doing a lot more on the security front. Is there something the industry could do to help us in securing that technology and managing the supply chain if china doesnt take advantage of the great r d that we do . I put that up as a jump ball. Yeah so the supply chain transparency management increasingly is a concern for us. Obviously we have been focused on a particularly in the i. T. State to what we are finding is its not enough. Its too narrow of a viewpoint and we have tried to certainly open our aperture and work closely with their busy partners to understand the entirety of the supply chain coming through the dia doors in our case in understanding each of the supply chains. Its daunting, theres no question about it but we have to do it and we are increasingly looking to our vendors to come to us with a transparent display if you will so we can understand it and so we can have confidence in it and really make sure that everything that comes through the front doors not compromise throughout whether its equipment, because the cameras going to could be chairs. We need to think or seriously worked together on in the supply chain. Understanding it takes multiple spaces of supply Chain Industry and on the government side too. Its knowing you are a target. There are multiple that the chinese are using to go after are cyber means. We know you are a target you have unclassified information target basic cyber hygiene encrypts data. Youd be surprised some that do that. But the basic cyber hygiene, knowing, having strong inside of threat programs that are controlling your sensitive but unclassified material so theres a whole host of things that you can do and we are in the department treating security as a missionary. Its no longer a back off an assumption that can be traded makawao. There are couple of areas to focus on. If i could add a couple of pieces. One is for the first 25 years of biker ahead the luxury of not being an economic intelligence and for a large part we relied on various partners with various capabilities to do some of those pieces for us. In the last three years ive spent more time in economic intelligence and understanding the difference between economics and Security Issues in the industrys ability to help us work through those issues. To echo a little bit on this cyber hygiene it protecting your networks but also having the same approach to counterintelligence. We are scaling up our perch to counterintelligence and chinas approach in other peoples approach. The direct access to what they want is not necessarily the path they are going to take. Chinas Global Presence and others Global Presence gives them a lot of opportunities so for me its asking industry to be cognizant of your networks are people in your connections, your vendors all across the globe. The last piece is a National Strategy really depends on our partners. Anything industry can do to help protect and secure the networks of friends partners and allies gives us a large desire to connect to them at speed in scale with data means we are going to have to rely on the security of their networks and theres a direct implication central security. Let me echo and Industry Partners total bed and get your reaction. You guys make it so hard for us to bring you the best technology but you talk about acquisition and you have built all kinds of structures. All sorts of things that fix the symptoms that doesnt allow industry to bring the best ideas , the best capabilities in the best technology. Wheres the department . Where are we in really allowing industry to help us be good partners. Does anybody want to jump on that . Because thats what i hear from industry. You make it really, really hard. The first person that told me that was jake jacoby when i took over at dia. I have got stuff i can share with you. Wheres the department on acquisition agility . What can we do better . Kari. Phone a friend and have allen lord sitting up here. They have done a lot that theres a lot of truth to that. Sorry, told them no gotcha questions and im sorry. I think theres a lot to that and joe kernan who has spent time at the edge of the sphere but then also spent time in industry. We know there are plenty of talented ideas out there. We are seeing services whether a couple or other vehicles to bring it. With me then we brought over 40 different Industry Partners from some of those smaller. Com startups. I will say and we need to do a better job practicing what we preach but when we say Agile Development and give me something in six months, give me something in six months. Dont give me a proposal for how you do it. Maven has been a great example where we put six months out there and we sprinted and had some pretty phenomenal capabilities that actually deliver algorithms to capabilities so we are able to integrate. Dont bring us a proposal, bring us capabilities and we will build it. Dont bring me a proposal and dont bring in 18 powerpoint slide. Bring me something thats useful does anybody else want to jump on that . I can speak a little bit to the congressional side of this. In the context of mars what we are finding in some cases a level of discomfort on the hill because its not well defined. Particularly if they are looking for us to justify resources and investment saying what is it going to be delivered . When am i going to see something concrete and how much is it going to cost . We are going to like some and we are going to not like some and well adjust. Some are still having a hard time embracing and supporting that. Yes the department has work to do on it for sure. We all have work to do on it. Frankly leveraging some of the flexibilities that do exist but we have to work with congress on the receiving end. They are fundamentally critical. I am very happy with the u. S. Dia response. You have one of the Biggest Challenges in terms of warning and the j to trying to get inside and i remember many times the u. S. Forces commander wanted 72 hours of warning. Have you solved the warning problem yet and if you havent what are the challenges and how we get after solving the problem i think a lot of people are citing we have a warning problem. They are citing crimea and mosul. Do we have a warning problem or an omniscience problem . Do we have a listening problem . Do we have a data problem . This kind of gets to a natural segue. What keeps you awake at night . It used to be in a federal jacoby here . There he is. I dont know if your member 25 years ago you said i just want it off. I wanted off. I want all the data and that was at that time it seems like a huge quest but it was a goal we could set. Now im more worried about what we are not going to at least even assess. What hit the cutting room board so that really keeps me awake. What hits the cutting room floor . We need an application and we need a series of applications. We need some additional help so we have the certainty that at least data has gone somewhere and it has been processed and i will just offer perhaps Machine Learning ai to at least u. S. On what i was talking about before. You need to know this and you need to at least consider this. Thats where i would say its the answer on what keeps us awake and its directly tied to warning. The second would we also related and that is assessing ourselves. How do we know that we are assessing ourselves. This is tied into the joint concept for intelligence operations kind of the second part which is a spiral estimate of our readiness so as we get into this globally integrated world in so many things could go wrong in so many warning problems could be out there opportunity cost etc. How do we know that we have all systems on all systems on go and how do we know the federation of setup is working how do we know we have the right number of analysts allocated to different warning problems that might be related. So its a complex answer to what probably seems that people like a very easy question. Can i add one thing to that . My vignette for warning that was instructed for me was again at pacom of all the warning problems that are written with precision and tracked by the most number of people to provide the most collaborative result that is the warning problem. Quite frankly there are three major aspects and one of them is warning of internal stability for north korea. When we just swapped out and i say just come its been a little bit. The cake commander happened to come to pacom headquarters and it headquarters and in the series of office calls. My first conversation with this. What do you need warning of and he rattled off three things which required a major rewrite of the warning problem. Step one is understanding what you want in designing warning problem in being comfortable to with two weeks later. I dont have any questions so we had a really great conversations and you guys dont have any questions. But thats okay. We have got to talk a little bit about cyberspace operations. U. S. Cyber command is coming up on nearly 10 years now from the early days. What are we doing in terms of intel support for cyber . We saw our way to the right policies meeting requirements from joint staff and combatant command. The cia organized for support of cyber or is it just another intel thing thats plugged into this . Jump ball. Having seen it from nsas perspective i was a part and i think we are actually postured better than people think. Mainly because cyber is inherently intelligencedriven. People are in the domain intelligence analysts are in the domain when they collect and when they actually help an operation to occur. So to think that its broken and that there is not sufficient intel support to cyber perhaps reflects some people who arent entirely familiar with what actually happens inside of an office room. That may sound a bit harsh but its true. Its very hard to describe just how much intelligence as going into a Cyber Operation without being inside the ops room so im more optimistic than most people on this issue. Anybody else . What does the future look like and what you need to transform if transforming it is the answer. What does the future look like . I wish i had an answer that. We are trying to gauge from the Barter Community what they think they need from it because it continues to evolve. It started as a core ip system and it was exactly that for many years. What we have seen over the last five years plus is an expansion of interest as the daily system. Its a Communication System regardless of classification and their possible reasons for for that. Its fundamentally trust and reliability of the system. Its understanding all the information you could need which rely on a system instead of going back and forth for jwics. See useful and efficient to many users but we are trying to generate more of that conversation to create jwics today what would it look like for the entire community the dod and broader federal and how would it be managed. We are looking at this as an opportunity to have that conversation because there is such a demand signal so we are trying to understand that so as we head down a path of modernization we are addressing all the concerns and the potential scenarios to wear jwics go. Really no longer an intel collaboration environments. Its command and control its decision support. Its an intel environment. All of the above to all customers at all times. The real question is that the right model and if its the right auto what is the design for the next version of jwics . It has certainly evolved from an into platform at the highest classification level to every combatant command every j5 every jwics. The followup and you touched on that a little bit what is the partner environment that allows collaboration in that space . There are lots of different versions out there but something we need to work our way through. Jeff you have been and for how long . Where are you now . I worked for mr. Curran in and ms. Kari bingen at u. S. Dia. Maybe i should have announced that. Another air force general. So one of the great challenges we have today is an awful lot of data being collected on all of us and what do we do to protect our data internal to the reservation data that is collected on us. Are we doing anything in that environment for our intelligence professionals and what can industry do to help us protect their data . At one level we clearly have laws and policies and regulations. There are a lot of Dod Instructions on how we protect information but then there is the actual mechanics of it and the technology. We have got the Investigation Mission coming to dod in less than a month now and as we look at rebuilding that i. T. Capability ensuring it is we have a clearance or credential that your information is protected so its building all of the cybersecurity elements in upfront into the system. I think theres a technology piece to it as well. Heres the thing that i want Industry Partners to think about. All of our data is available out there to any of our adversaries. The data we try to protect his available to our adversaries. We have closedcircuit tvs and cameras and eddie every city that captures data. What does that mean for us not only of society but for intel corp. That we protect that data and how we make sure its very sad able to use that data . How industry can help us think our way through biometrics closedcircuit tv all the data thats out there on the dark web thats exposing all of us but more importantly some of our very sensitive information. How can industry help us all but dropped them . You think of all the super squirrely stuff we do our human intelligence or counterintelligence. The last 15 plus years has been very much focused on hitting taliban and afghanistan but when you have a sophisticated adversary those skills have atrophied quite a bit in the last decade and half and we are working on rebuilding that. You are not rebuilding it to what you did in the 70s or the 80s. We are rebuilding it in this modern Tech Knowledge environment where there are surveillance and everything out there on the internet that are agencies and how they cover all those aspects of our core intelligence mission. All right, does dod see commercial satellites as an alternate technological need . I will say as a complement to National Technical needs. You are still going to have your need out there for some pretty exquisite highresolution capability and other features that those satellites have maybe some additional protective measures given where the threat has gone. You are willing to pay a premium at the same point in time is it an exciting time to be in commercial space right now. I visited one place a couple of months ago where they are finetuning their production line. Its unfathomable for someone for years so there is some exciting things there. From nro to others please take advantage that. The other piece of it were industry can help us quite a bit is not just on the sensing side but the tea t. Peck sighed pretty good a ground station today it is manual labor. You have people moving around ours on computer screens. When you start getting into the consolations of the sizes we are talking about you cant have a person doing that manually. All these automated tasks and collection optimization and the processing side of it moving some of those algorithms and processing upstream further freeing up analyst to do other things. Theres a whole manual laborintensive linear set of processes out there that we must do better and if we are going to be dynamic as you were talking about earlier we must be more responsive to the threat environment we are seeing with china and russia. I would offer as a former j. Twofer africom a place where we have partners that really appreciate some of the commercial imagery theres a perfect application there as well. We are partnering as we are talking about. If i could add one or two vignettes to that as a former j2 the commercial imagery gauge that we have seen have been absolutely crucial and helped us get the most out of the national architecture. For example 52 of the Earth Service a lot of that covered by water so how do you track open waters and how i track north korea. A lot of times it was a highresolution image and using commercial imagery at every stage and being able tothose together and away they gave me the best picture. The best picture i had was always a combination of various pieces together so i think thats really the picture. How do wethat together from this point on . The ability to extract information out of commercial imagery and making that readily available and we had a conversation earlier today about synthesis. Theres a lot of data. How do we take all of that down to those two or three Key Takeaways that we need to make decisions and a highpriority environment and the ability to extract data out of commercial imagery is an important business line. This one came from the audience. I was wondering about this earlier. Talk about all the technology in the workforce. Is the workforce ready for this and what are we doing to make her workforce culturally ready for this influx of technology or is it the same workforce or is it the same workforce we have same workforce we have had over time . Would we do to prepare her workforce for technology . From dia perspective it so but above that some of our existing Market Forces that are hungry for it are eager to continue evolve their own capabilities in and the habits on how they Leverage Technology but some of it is going to have to be trained. Some of its going to have to be hired to some extent about we are trying to do is hone in on what does that look like . Do we have to seek out and recruit and defining that is still part of the puzzle if you will that we are trying to piece together. At the workforce in many respects we have such a great workforce. They are very adaptable and interested in trying new things. I like experimenting and they are innately curious so you put new technology in front of them and they will play with it and they will figure it out and figure out what it can do for them and they will take full advantage of it is a question of how we leverage that and how we encourage and develop that while rounding it out. We still have gaps in the hiring in the training. We have analysts obviously who were source by dia and especially younger crowds that are looking for it manages all the time. They are always looking for an advantage. New application. I dont think we are going to run into a situation where analysts are going to feel in competition with Machine Learning environment and i think youll find a complementary and they are not actually going to find a substitute. They are going to find it as an addendum something accused them to a better product. How do you train them because the training that we do today is probably not the same sort of training in the preparation you need for future analysts in and the future workforce to this environment. Is there something in the industry in terms of how we train and prepare her workforce to be successful . I want you all thinking about Virtual Training and immersive increasingly complex training. I want you to think about how painful it would be to have the instructor standing on the podium lecturing as we prepare her workforce. Is there a different training model . I can envision a situation where we put an emphasis to use the tool so the analyst knows the left and right limits of the product and the queuing coming out. We probably need to ensure that they are winning. This is based on what could be a bad variable. I need to regroup and try again. We went through this a long time ago with maven and everything thats happening. We actually looked at the automation of the targeting community and there are some tools that make things very quick. They also cut a few corners in the interest of speed. As we thought about it we said we want this tool but at the same time we want to know where its potentially dangerous to precision and accuracy if that was the basis of certification for using the tool. The tool is actually used. Its not a substitute for the oldfashioned way. Its to complement the process so i could envision analytically a very similar environment. Know what youre left to right limits are in terms of tolerance so you can queue to yourself and your chain of command that this is based on Machine Learning and we might need to take another round. We need to preserve the hard Critical Thinking skills of our analysts especially with all these different data forces that are more readily available at their fingertips fingertips. Whether it be Machine Learning tools and the traditional imagery. Even publicly available information for we are using us how much more but you have to be able to discern how reliable and how credible it is and what decisions are being made off of it. There is just an evolution of the tradecraft and the credible thinking skills that have to evolve for all the data we are getting our hands on. Lots of services are talking about it. When i started in this business the army and air force did their thing in and the air court did their thing and then we started talking about hinterland and now we are talking about multioperations. What does that mean for the Intelligence Community number one and the joint staff multidomain operations and the globally integrated role. We talk about china as is a regional problem but its actually global problem. Theres a challenge to maintain operations in the globally integrated environment. I think id go back to how to assess the opportunity risk as we are a bit too fixated on a regional problem. That not an inherent part of our tradecraft of the moment and getting back to the training piece its something well have to work on. Lets just imagine we have training and we have decision tools for something as simple as moving from point a 2. B. In our smartphones we use google maps and waze to help us assess how quickly and whats the best way. You are going to use different choke points. Imagine that they are different variables and everybody here we are just testing testing the moo to make sure its correct. We have an armada of cars trying to do an objective as well but there are others who are having an armada of cars and they actually want to con found your solution. Imagine all the permutations of that. That starts to get very complex when you think about the money carlos or the opportunity cost and how an adversary might take advantage of your dilemma in a particular place. How does an analyst efficiently succinctly addressed that . That is not something we necessarily are trained for. I would add on the back end of this multioperations would require one service and on behalf of perhaps a Third Service how do we all have that same picture that we can have a common understanding and that requires an interoperability into standard to achieve. And then there is the integrity of the data that flows and to get after it trey paul is my point if you were doing longrange over the horizon fires between a shooter and a target you are not causing fire to go astray. There is a tech site of multidomain operations. Once we worked through that piece it becomes the ttp and the trusting confidence in how that would work in the globally integrated environment. I dont want to speak for the admiral and the navy because i think these things are still going on but let me talk as a naval officer. I think the jury is still out. We are talking about the domain of space and cyberspace and how specialized these domains are we have to ask ourselves whether generalizations especially officers is the right path or whether we might need to think seriously about specialization. I was having this conversation with admiral jacoby a while ago. We need to seek General Assembly might need to adjust that in cyberspace going back to your question. A very specialized craft. We might need to keep people at a keyboard for a long time as opposed to backandforth between the domains we have on our services. On the business of mars is to enable multidomain operations as well. Fundamentally some of the key efforts on mars is to understand and try to pull together in some form or fashion capabilities for the services youll be using in leveraging and common access to that data and feeding it back and forth. Thats a fundamental precept of mars Going Forward is how exactly to enable that. That amount of plumbing that we still need to do in our community and i will use you see gss for example. Its a Common Ground system and we have seen each service has developed its own capability. Although you can share products are raw data isnt it exactly interoperable. Theres a lot of work we have to do on interoperability the data standards and formats and architectures we talked about earlier but then theres also you have to be able to trust. Someone else is going to provide data and that you can act on somebody elses data. In the Defense Community they have had to work through that in the last 10 years or so. I think we need to apply some of that learning to other areas in a multidomain. Talk a little bit about creating an opensource center. Some thoughts about how that might work, the implications of if you do this you will bump into the data. Can you spend some time expanding on open source . Sure and october is when we open the doors to speak in a more formal way than we ever have in the past and this will grow over time and evolve over time so part of it is the structural change for us and organizing dias activities more specifically to include dedicating pete winds respective centers. It really will be the hub of those activities in that location. As you indicate part of it is what is the tradecraft behind it and what are the rules behind it and again i think because so many of our analysts have been kind of in sort of doing it on their own for many years the imperative is clear that we have to bring a plan to this particularly when it comes to that person to make sure everybodys doing it appropriately and accurately and from an oversight perspective that we can stand by it. Its a significant change and there are a number of reasons for it but its going to be an evolving effort because we arent going to wait until we have all the answers figured out before we embark on it. We are going to jump right in and fashion it as we go. The good news is we finally have figured out this is fundamentally something that is structural and theres a dedicated career for it and for many of our folks there is enough of a career there and enough of the discipline their do we can call it as such. I think what we are trying to figure out is what does the enterprise to . We are focused on dia creative enterprise as a whole Weather Services are broader command what have you. They are going to have a role as well and thats going to be the next step that will have to define is how do we leverage the enterprise and figure out who can do what and who brings what advantage to the problem and figure out how to knit it together. Its going to be a Community Effort even after we open the center. I think one degree applications of Machine Learning at ai is not necessarily finding its doing attribution of that data and we can use ai Machine Learning to discern the person behind that particular bot or poster or whatever. I think there is great opportunity for ai machinery. Vetting premium is huge here. I cant say enough about actually a form of Early Warning especially in the where we just dont have data collection. The speed is unmatched so you really need that setting behind that particular oneliner to find out if this is an Early Warning that we need to pursue or do we need to ignore. In the intelligence committees assessment china dominates 5g communications. They are prepared to protect government commercial 5g networks. Can you jump on that one . I dont know that i can see the broader Intelligence Community. I would say its one of their national priorities. They have put a lot of effort and resources behind wanting to dominate the 5 g. Arena. Technologically i dont think they are there yet so its not a foregone conclusion well continue to stay after it. In this scenario when the department are spending a good amount of time on it and working with the Intel Community as well to make sure that folks understand the Security Risk and their foreign partners whether european or middle eastern or asian partners. There is a clear, it may be a great package deal today financing tied up with a bow but you need to look longterm at the Security Risk. The onus is on us as a department particulate what with the military and security applications are of relying on the chinese or huawei built 5g architecture. For starters he of the china National Intelligence law that mandates that companies and individuals, compel them to cooperate with the Chinese Government but on the military impact site whether its intelligence sharing or mobility , there are tremendous amount of areas that would be effective with trusting telecommunications capabilities with our close partners but its been a challenge working with allies and partners beyond some of the nearterm economic and if its to look at those longerterm Security Risks and the National Security folks, the Commerce Business community. We are working in the department within a research and Engineering Group so dr. Griffin and dr. Porter are leading an effort to create an integration test bed. Whether you are a u. S. Or the companies and there are other companies out there that are probably leading. The u. S. Does not have the only solution that they are working on an integrated test bed so companies can come and test out all the technology and work with the integration pieces of it. There are viable alternatives to the chinese 5g technology. I think you touched on this a little bit already. Im looking for the black swan, looking for the things that we know russia china iran north korea. Im going to come is with you. Very few enemies are for serious keep me awake or its more the knowledge of ourselves and the readiness of our own systems ensuring that we are not missing something and seeing the big story and putting the pieces together. The things we have talked about today. Thats what keeps me awake. I would absolutely say the same thing. There is no adversary the keeps me up at night. It is about our ability to sustain over time a longterm disciplined approach for the various problem sets that are out there. How do we address the urgent needs and import needs currently and can we maintain that so thats what probably keeps me up at night. Your black swan questions question is a little bit different in my mind. For me that is about an area where there is a potential for escalation that we have not been through that cycle previously and know how to handle it. So if pakistan border you need the china border. They have worked through these issues methodically over time. Unit for me i think its the risk we assume every time we have to make a decision. So clearly we have many more demands we can never meet. Requirements and resources just wont keep up. Regardless though we are almost on a daily basis having to make choices. Obviously there is risk in every choice that we make. We can communicate that risk all we want but we worry that something is going to result as of our decision that risk is either not going to be appreciated or were not going to be able to respond. We have a Tremendous Community out there National Intelligence invokes are working 247365 days a year so i dont know there is anything specifically that keeps me up at night. Ill echo what im staying, and i thinking on the last couple of days, we are on a phone call last friday we were asking ourselves. Do we have the policy in place for the folks that need to take action, over the weekend or on a holiday that they have the authority in the policy and the guidance to do with the need to do. Making sure that we have thought to those in the policies of making sure that we have provided that guidance to them so they can go off and do what is best. Ill give you one more chance to talk industry. 123 priorities. What is it that weekend help with. Helping us modernize our very manual intensive linear processes. The more i see an encounter in his community, there are a lot of them. We have finetuned and we need help on these. That i would say helping us involved in areas like ai and getting those scaled. Getting them out to the field. I would be remiss if i also didnt talk the security fees. The china and russia who are intent on getting after our technology and our intellectual property and our people. We have to respect that. We have to make sure that we have custom workforce and we will need industry helping all of those areas. Will exercise one more time. But then obviously with mars and the best example. The date we have of working with industry and asking industry to challenge our assumptions on what we think we need. To help us think through and help a little more creative thinking. That obviously takes understanding and engagement to live in our shoes a little bit. So that you in fact can do that. I do worry that we all kinda fall into the trap of just presuming we know. And asking you to deliver it. We have to step back and challenges on that a little bit more. And operability. Standards, the older models of proprietary data standards. They serve us well for a period of time and i think weve discussed that. We need to look to the future and understanding data. The more we partner industry and then collaborative development. If we are to solve the actual acquisition kind of things, it means art with industry from the very beginning of what we do and how to be held together and how do we deliver some set of what we started with. There is a Business Model somewhere in there. Industry does it well. Theres a path to the government in there, partnering with the design and making congress comfortable with that sort of strategy. When the functional managers for three disciplines. Warning collection management and targeting. We have been talking to is it too much about targeting. I am going to offer three things that order. In warning, just helping us not sacrifice accuracy and thoroughness. Completeness proceed. In collection management we need some help automating the proce process. Our automation management as stated. And targeting, we always need help in this. This will be the case from now until eternity. This to establish the enemies from non enemies. Give the panel around of applause for spending time with us. [applause] hopefully we give is it too many jump balls thank you all very much. Saturday 745 eastern on big tv, the books matter what party in washington dc. Three publisher audrey ory. Angel ridge, author of the history of the black dollar. An White House Correspondent april ryan. Author of on fire. At the end of the day, those they never realized there would be questioning bill clinton. George w. Bush, the first black president , barack obama and they never imagined that donald trump would be there idle. I stand on those pillars. Of our Founding Fathers could do. My story is your story. Then at 11 eastern, and republic, the father of this student killed in the shooting at Marjory Stoneman high school. I was in parkland florida offers his thoughts on School Safety and guns. In his book, like meda died. Is going to find out why my daughter got killed. I was all of these leniency programs of these kids like they had the first kid before school. He was so dangerous. I found that out. The first him and he wasnt allowed in. Thats how dangerous he was he threatened to strip the school up. He was not arrested. He threatened students lives and was never arrested. And sonny and i eastern on afterwards. In his book the years that matter most. All tough reports on the challenges and costs of a college education. Hes interviewed by sarah culbert. Author and founding director of the hope center for College Community and. Were still debating both of a 12th grade education is enough. Its obviously not enough. In all of the time, the economy in a labor market its not enough. Unlike our predecessors who are able to respond that basic Economic Science by staying okay lets educate our young people, we are fighting about it and turning it into questions about entity and snobbery and politics and partisanship. When clearly, there is just a sign that we are or our young people need our support in our help. Need more education and credentials and skills in order to survive. Watch book tv every weekend on cspan. Cspan his washington journal live every day with news and policy issues and attack you. And coming up saturday morning, the american vaping associations negri comic will discuss Health Concerns related to vaping and ecigarettes. Also nini the wilson center, beyond the relationship between the United States and ukraine. Then on our spotlight on magazine segments, Bloomberg Businessweek his susan birthday will discuss the issues with fda oversight of generic pharmaceuticals. Be sure to watch cspan washington journal live at seven eastern saturday morning. Join the discussion. Looking congress to make schools safer from gun violence. The House Homeland Security holiday ring to find out. Missus include Security Officials and the parent of a student killed in the Parkland Florida High School shooting. Parkland shooting survivor, and cofounder of my car lives, also testified and offered her ideas during this two hour hearing. [background sounds] cabell. [background sounds] the subcommittee his meeting today to receive testimony on engaging the communities respective of school security