I think i like to think of it as efficient a pond. Maybe there are 200 fish the side of traditional human societies, everything is going okay for a few years. Then a storm happens in the river opens up connecting that fishpond to the ocean. New fish swim upstream, the environment is fundamentally different. We are in that situation today as a society, things are changing radically. Actions have outcome at a distance and that is what link is about, the actions that we take and the decisions we make as we consider the actions in the past through which those actions become reality. How can we be responsible for the outcomes of our actions if they are invisible, if we can see the outcome of our actions, a fish in a larger ocean, we simply didnt eat all the for this situation. I am lucky i went through the computer revolution. When i was a kid computers were big old things no one could use, my mom didnt know the difference between software and hardware. We have gone through a massive democratization of computing technology. We are in the same cusp today with ai and data. Ai, we dont have control over it. Data is overwhelming, at best we get a data visualization. I had the honor of interviewing hundreds of people as a Technology Analyst and asking them what you are frustrated about. Of technology could solve one problem for you what would it be . Over and over i heard a similar answer that looks like this. This is why i am pretty sure i know what i am doing. I have been building Machine Learning, applied systems a really long time over 30 years. I was funded by the human genome project in graduate school, built 100 million budget for the government, i have built thousands of Machine Learning models mostly supervised learning, back propagation, who would have known it would be with us so many years later. So i believe this background has given me an insight, something has been missing all these years. Something coming up from the technology instead of putting humans at the center of the occasion done. And i like that he called it intelligence augmentation. Ai, flip it upside down to the ia, putting humans at the center of the equation again. When i interviewed all these people i found what i called for a while the decision archetype. What is the decision . In action, a thought process that leads to an action. Action in a complex world flows through some stuff and i dont know what buying that scarf will do to the world. It is going to have some impact but i dont feel very motivated because i cant steal the the impact, it doesnt grab my primate brain in a way that makes me think i really need to buy that hybrid car. I cant see it and the data stat today isnt giving that to me. This is my dog. I am training him to be a service dog. I have had him his whole life. Is 11 months old and i had an awesome thing happened to me. A trainer teaching me to train the service dog teaching me about antecedent behavior consequence. My head exploded. That is what i heard from humans i have been interviewing, executives i have been talking to. Always talking and antecedent which is the context. In the kitchen i say sit, the behavior, dog sits, the consequence, he gets a cookie. This is a universal archetype, not just one way to think about how we might use ai and data. I will tell you how that fits in in a moment. Im certain this is the way to think about it because it has the lowest friction to how humans think. Lowest friction to how humans naturally think, and busy people live in complex environments. They dont have brainpower for optimization or inference methodology or any of those things. We have to meet them where they are and the fact that we are not has created a cultural barrier between people at the head of government, at the head of businesses and even be as they try to make decisions and use evidence and data and ai to help make sure those decisions have a Ripple Effect that is good so farmers im working with have to decide what crop to plant, down the road they dont know if it makes them productive or what happens when they have fewer migrant workers, the situation has changed. Businesses might decide where to acquire a company or what product a larger what price to change and as they think that through, much like my dog here there is an antecedent, theres a behavior, we will watch this product at this price in down the road somewhere, my dog is immediate, he is a dog. What makes it special is we can think through long chains of consequences but that is limited and we need computer help so again a decision is an imaginative process in our head as we think through the actions in some context that will lead to some results. If you remember nothing else remember this template. What is cool about decision intelligence which is what the book is about it is because we start with humans, you can take home and use immediately. That is my promise if you stick with the talk. How do we make decisions today . I am sorry to say i had a sense this was happening especially in a complex world but going back through millennia of Human Evolution we dont really think through the consequences of our decisions very deeply. We are more likely not to think through things rationally and instead use social signaling, look for someone who looks successful in our society, dominant or prestigious and copy the decisionmaking. It turns out that is very effective. Hugely successful for the human race, that separates us from many other species. We are great copiers and cultural evolution theories as we develop behaviors and patterns any individual cant understand but society like the unconscious process of genetic evolution we use cultural evolution to come up with these behaviors. We are programmed to look at some prestigious or dominant person and do what they do as opposed to thinking through the consequences. That worked great for a few millennia but the situation has changed. If there is a bad actor here or here and they tell us what to do and they are smart they can subvert our behaviors, influence us to make decisions that benefit them but not us if they are smart about the situation. Second, the context is rapidly changing. We need to develop new ways of coping with the big ocean that is fundamentally different from our pond because it keeps changing. There are new fish in the old ways of thinking through problems are no longer working. These have complex system dynamics, feedback affects, winner take all patterns where large companies, 90 of the benefits and massive inequality. Action at a distance we talked about, intangibles are important. Anyone who has worked with data, we tend to focus on the measure easily. Money, size, price. We tend to overlook reputation, happiness, more row. I never build a decision model that didnt have at least one feedback loop that involves something intangible. We must Start Talking to the sociologists, cultural evolutionists and all the other disciplines to understand those factors. The decision intelligence creates a roadmap for how to do that. The other thing i didnt phase the future is no longer like the past. When we assume the past and the future are the same, we didnt realize the situation has changed, office was used to be white and now they are black. I believe ai which im going to tell you about, decision intelligence can solve this problem. I grew up in appear go of technology optimism. We are sharing our code, the internet was going to democratize, we were going to collaborate. We had a dream and i dont think we have realized that dream. I think decision intelligence will help us go there. I think we created a number of links in the chain, learning collaboration, social media and one more link we need to start to make a big difference, to have a nonlinear impact. We will start to talk a little practically right now. How do we do di . We start with people. We dont say where is the data . We dont say we cant do this ai like thing without data. Data is great but there is a huge amount of Human Knowledge that has no data set whatsoever. We are good about knowing how actions lead to outcomes in your homework is to go home, ask a friend how they think about a complex decision. They will talk about actions or intermediate effect and that will lead to some outcomes and talk about context. I sit down with a diverse group, old, younger, gender, what outcomes are you trying to achieve . So Many Companies have big projects. And many organizations, what are you trying to achieve . The list of outcomes is different for each person. You dont need technology to get better. Just a brainstorming process where you think through what outcomes to achieve as a team, higher revenue, net revenue after two years, some kind of military advantage, a back lash its us with the reputation of our country. What outcomes are we trying to achieve . Make sure you ask that question. Second, brainstorm through the action. Many folks dont take the time to have an open brainstorming session where they are allowed bad ideas and funny ideas, actions that might achieve those outcomes, to the creative side of your brain, when the blood is in the creative side or analytical side of your brain which is over here maybe you dont have room for the creative side so separate those two. Spend time being analytical. These triangles are where ai fits in. Most models as we democratize ai, here is the pattern. A decision i am facing today, i saw greta on tv and she was so compelling. She said we have a Climate Crisis in the way we solve this is really simple. Stop worrying about analysis. At the very least pay for some trees, organizations all over the world will take your money and buy trees and those trees will grow so there will be more biomass and that will sequester some carbon and if enough people do this perhaps on its own, dont know she said trees alone would do it but it would make a big difference. I havent sent any money to a Tree Organization yet because i cant visualize how the money i might send leads through a chain of events to some outcome. If im going to use ai to benefit me i want a visceral interactive fun experience. This is what i think is the future of ai, looks like a video game and i hope we can do this in the basement. We can walk through these spaces. What are we doing in these spaces . We are experiencing with actions we might take and letting the computer help us understand the chain of eventss that sets in motion to lead to the consequences. Valuable at a personal level and highly valuable in an organizational level. Lets see if this works. I have been having a lot of fun, i really like it. Theres institute for the future ball, this shows you a physics Engine Running here. What is going on here . We are trying to make a decision how much money under the pay each year to sequester carbon. As i change this decision this data is telling me about the future that puts in motion. I spend money, change the decision, changes the number of trees i will purchase, heres the biomass, the carbon sequester, the total atomistic debited atmospheric carbon. I can see the chain of events. Linda ritchie is the expert in the background who has done some research and barry hayes has done some research. Except first has an opportunity to say how actions connect to outcomes. I can change my decisions and also who i can trust because i can see different people, different experts claim different things. I can click on their names and go to a site where i see them making their case, their model for how it leads to outcomes that can help us and that will be like wikipedia. A site that is cure related to understand the situation. It looks like a Business Intelligence dashboard, looks like stock we have been building for a long time. It is not. We are not looking at the data set here. We are looking at the future. Let me summarize so you can understand it. In the background we also have a physics engine generating implications of those choices. As i changed my investment, i can see how my decisions interact with the situation as they characterize it to impact the outcomes i care about. This is a universal pattern. This example is an example of something you do in your head 500 times a day and Large Organizations struggle with understanding the impact of todays decision tomorrow so i will give you a couple examples. These are Machine Learning models in these triangles. We might have built a machine, whether a Computer System has a current intrusion happening now. That is a common Machine Learning model. Machine learning is widespread with intrusion detection and gives us a score, 20 , 95 , pretty sure there is an intrusion right now. Here is the type of intrusion. This picture is typical of many decision model, it is mapping how people naturally think. I promise you if that is how you are thinking about things it is a lot better to have it on paper than to keep it in your mind and explain it when using invisible mechanisms, word and text which is inherently linear to communicate these decisions. We need a blueprint like this, a learning system that shows how Machine Learning fits in. I could send information to the police, investigate the intrusion, and impact some outcomes. If i call the police every time it might be pretty costly. Police only when necessary. This is a decision model i built with a bunch of farming experts as part of that big project i talked about, 23 phds and finishing up the proposal this week, a National Center for excellence in ai and agriculture. What is important about this, i didnt have to explain decision intelligence to anybody. I sat down with my diverse team of experts and said what is a typical farmer trying to achieve . They want to be profitable at the end of the year. Is that all . They wouldnt want him to take any action that will put him out of business in a few years so that is a second goal they need to balance against that. Making choices how they spray their top, spraying schedules, the choice of crop, this gives us a map to understand how the Machine LearningTechnology Fits together. There is a model tier to tell us how it will impact the yield, another model, the contaminants based on the sprain and these are sensors that farmers might have on the field that they can use, we went as Early Warning as possible so that we can spray as little as possible to achieve our goal. It cost a lot in longterm viability and the climate and pollution point of view. It is kind of spaghetti but having it on paper is better than what is going on right now which is this invisible in peoples heads. It becomes an artifact and we talk about design thinking, we designed a decision, something that we can design. That is pretty radical but we could bring all those things, best practices to decisions. We can you a this thing and continuously improve it. It acts as a blueprint, this is their mental model but it connects them to the ai people so they know where they fit in. Before we did this diagram i dont think anybody knew how it fit together, you dont have to explain in words anymore. We have a map. We know how it fits together, where the ai will go in. What is going on with decision intelligence . It has been quite the slog. I am trying to talk, sometimes three people in the audience trying to tell people the story, to the extent this matters on its ai hype cycle. That i consider a big accomplishment. Ibm, google trained 20,000 people, she is awesome, google her and a bunch of companies started to identify, most in specific areas. These guys are hr curriculum labs, medical devices, these are all people who recognize that if they go beyond building a Machine Learning model and put it in a decision model surrounding the Machine Learning model, connect actions to outcomes, that will help them be more successful. It is really cool. I love that we are starting to get this. This is how kathy defines it, a discipline of turning information into better action at any scale. We have a different way of saying it but it is essentially the same thing. Di answers the question if i make this decision today which leads to this action, what will be the outcome . Lots, my causal decision diagram is mine, other people have other approaches. Some people dont even come from tech, sociologists, economists, and more. What is common to all of us as we have taken seriously the action to outcome as the wave of technology and science interact. We made it to hollywood. Who knows what show this is . It is the good place. I am not going to do the spoiler. This is episode 10. I recommend you take a look at it, he basically discovers di by the end of the series, the big reveal which is so cool. Who knows who this is . That is janet. Is she human . He is trying to understand these unintended consequences and janet was helping him. How cool is that . I dont know if they read my book. I hope they call me. It is so important to the future. With great power comes great responsibility. You have the ability to take actions as an individual and organization that have a giant impact. Im an optimist. I believe we are at the beginning of a solution renaissance where it is not just ai but all of these technologies will come together under a common blueprint, system dynamics, computational neuroscience, cultural revolution. These are viewed as soft fields in their little silos, deconstruction of 1000 years of being specialists. We are entering the age of synthesis. Those of you who are neogeneralists now what im talking about the we are the expert to focus on the outside of these boxes, doesnt matter if we know about Operation Research and we start to now using some version of di how to glue that to get her to crystallize solutions, we understand a solution to water impacts poverty. A solution to poverty impact the status of women. Those impacts hit all of us, they had governments, democracy, companies. We call these the Sustainable Development goals. I think they are all the same problem. I dont think we can solve them separately. I think the only way we can solve them is to have a new approach to understanding bouncing around to the whole world and ultimately lead to the best outcome. [applause] a share transporter. I am shocked that you finished under the time. One question i have is the case study that shows how this works in practice. The example i showed with farming is a good one. We also built an initial model for the government decision regarding conflict in a subsaharan african country where the model showed a preliminary study, it showed you need to take action in two places at once, youll of lost training and other things, if you did those things that is a vicious cycle of conflict to a virtuous cycle. It was a test case. It is for 5 links long. It was a preliminary study. How long did it take . Spent a lot of time interviewing experts. I wonder how much this is metaphorical thinking. Metaphors and how things are like other things and imagine it extending that way. Part of the future of di, the systematic patterns that happen in one place, and action we think is good and it is good in the short term. I call this the lobster claw, it leads to a negative consequence, doesnt tell us that. I see that pattern everywhere. I see vending machines in kids schools, makes the kids happy but down the road may be diabetes and obesity are not good things. And other things as well. A couple people for their comments. The ceo of inquest, ask a quick question. Good to see you again. I have a background in climate science. Really interesting time when everybody is weighing in, which i find interesting because a lot of people naively want to speak to these links. They have facts and dont realize theyre putting in the leaks, it is solar flares or i have an idea or i have an idea, you want to see spaghetti and i think about your metaphor and the challenge about teaching the science and leaks and mechanism. Would you be able to not help teach the science that demonstrate the complexity, starting to appreciate not seeing the complexity. And ways to make this a tool to influence, having to go through it. I use a metaphor to answer your questions. I can drive your ferrari without seeing what is under the hood but certain people are really impressed when you open up the hood and see all the complexity. Some of us dont want to hear about that. We want someone we trust to tell us if we take this action it will lead to this other outcome. From people we want the ability to open up the hood so we need a multilayered approach to this, we have to have beautiful video games that grab your attention but also have to click on the expert and see the top process that led to the mechanism of that model. They dont know there is something which you speak to. You make it look easy but they dont think they can build a ferrari. We need both. As technologists we are abscessed with under the hood stuff and havent paid enough attention to the user interface. The old interface as we were saying. Do you have anything scientists, ai and the brain. Thanks for a wonderful talk and a great book. I loved when you are saying the vision we had of the internet was just getting started. All that positive, going to bring humanity to gather and you see people of the world and understand them and increase ambient connection and the reality is the last few years has been more divisive nows, tribalism, breaking into pieces. Trying to imagine a world in which di is everywhere, everybody has tools to make decisions in better ways and i wonder if you think that will help people understand one another or bring people together . What do you think the impact will be . It will increase our sense of agency. There are a lot of people who feel overwhelmed by the information. Executive i talked to say this in particular. I dont want to talk to those guys, i cant understand a word they say. If they have interfaces like this they will engage with the evidence in more solid ways with the data and ai and if they get the janet assistant they can do better. Im not a sociologist but it seems weve all got it is too complex, cant figure it out but the biggest initial impact, balancing the inequity when technologists dominate the world and make us click things and we use it, and hit inequality. Lets democratize ai in the complex technology stack. Steve jobs launched the mac 36 years ago. Lets make this do that. Over the mind. This technology potentially really empowers people and democratization of what is today it is so important, you dont need to read the book or learn tax, just brainstorm your outcomes and actions. If you do nothing else, we are not doing it. My recall, somewhat of an argument, you are actually designing a tricycle and what i am designing is a Mountain Bike and it was real attention, too simple furred doug and the good news from what you are talking about, most really big changes take 30 to 50 years to be an overnight success. In a real sense, 67 years ago. Ai was 1956, di was 2012. A long time ago the debate was whether to call it Artificial Intelligence or augmented intelligence. That was the darkness. The wrong side won i think. The ai won. To me that slowed the evolution of the field, but the good news is the role that is coming together and can actually work, you can have a tricycle. What jill asks fits well, shes a brilliant technologists misspeaking on your behalf, might resonate, it is tricycle. You need to be more sophisticated and complex but dont have to be either or. If we take seriously we are low friction with how humans understand and build the engine, ai feels like weve been building car engines for 50 years but nobody ever built a car and every engine has a different drivers seat instead of control. We need to build a common set of controls that is easy for everyone. It is classic information hiding, Computer Science principles. That is a great question. Thinking about the stories implicit in understanding these fields and wondering implied or perception, when there is a wikipedia entry about one of these people there are pools set up for how people can edit those entries or not. Would it be possible or should it be possible to have multiple visions of these different characters rather than only having one perception of the outcome. This is the challenge and it will happen for the next year or so which there will be a new kind of wikipedia which has rules that maximize how to get reasonably Accurate Information from crowd sourced thinking but instead of giving facts this is where data, we get connections. When you do this it causes this. When you give this money to this charity by 10 trees and someone does that thing can will curate that and say here is the reasons, you will get one free and someone else will have an opinion when you spend dollars with his charity, then someone else gets the next link in each 3 will have this biomass and another expert says it has this biomass so we create a worn data version of wikipedia that talks about links, something living as opposed wikipedia is great but doesnt say when you do this it causes this and that connection between things the cause of the things which cause other things is what we have been systematically missing for years. That is where bias gets helped. What is happening with ai is we are getting unintended consequences because we are not modeling the context in which the ai happens. When i start a new ai project the first thing i say, they say we have the data. We are closing the data, i say put the data aside. Tell me what the decision is this ai will be used for. And as we understand the context of the decision that will be to some outcomes, i might build a long ai system that we can do without data, data might help but if you have software engineering, if you dont understand the requirements you will just build things that break and some Research Says 9 of 10 ai projects fail. I like your point about the car. One topic, strong correlation, access to birth control, a very simple link for intelligence all over the world for family planning. This is a missing link people are not aware of. They talk around it, what do we do about overpopulation . We need to educate women, make them economically viable, lots of secondary effects. Looking at this primary link. Your envisioning what technology can do. I would love to see the technology, with multiple interpretations and somehow men can see that. That is a fatter link. I dont think we have a lot of research that demonstrates these things. Science has given us randomized control with this intervention and we get this result. Weve got a lot of results. What is missing is taking those individual link and connecting them to actions i could take today. I care about the status of women globally. What can i do about it . Show me evidence in a picture, Virtual Reality and augmented reality, make it fun, make it immersive, make it cool, i can see as i move this lever and pick my expert, maybe jill will curate that link and have other people curating as i can see womens happiness, we need to have deep immersive displays. That is the piece that is missing, we have great data but dont have the last piece where we democratize and ive through the change of events to give a sense of agency. People in this side. Im interested in what it is because they twist and turn and all the behavior is predictable and the biggest thing and that is a different sort of model and having an organization and you can see it is like cultural religions and people dont know what the decision will do. It is quite a powerful adaptive model. The thinking level in a way. For 2000 years, ai was the extreme example is we are only intelligent if we can verbalize and represent inference and massive amounts of subconscious rationale and the emergent intelligence where individuals in a group none of them can explain what they are doing or know what they are doing on their own. Somehow signals give emergent intelligence, cultural evolution knows that humans have been doing that. We are in a new fish pond, and how we behave like birds doesnt work anymore. We are in the ocean. We surface assumptions and create a challenge to the cultural evolutionist to study the emergent behavior of humans as they make decisions. It is an invitation to Work Together with the data of the world in a coherent way. The great point is we have emergent behaviors and complex system. Alex lamb knows this better than i do. We understand how we get that emergent behavior. Hopefully you can help. The book i am starting to read in a certain sense, i hear you articulating something i have been spending most of my life trying to explain to people. I am curious what have you found is sexist when you go into an organization to provide consulting or coaching or teaching in a club and how do you get these ideas across more effectively and tools that you find that are useful . I go and i should say naked but that is not good. I dont want to bring my biases into the picture. I have a methodology, you brainstorm your actions and you elicit the sense of the change that gets you from one to the other and only after we have done that do we do this whiteboard picture. I clean it up and we look at it to gather or use any special technology. Only after we have an agreement do we bring in one of the immersive visualization environments and then we get the intuition going and the decision dashboards not just from the past or present in the situation we are in and the data feed with climate and gdp, heres where decisions are going to go. It is all new. I dont use a lot of tools, a lot of Machine Learning. You present this material to people, the visualization and the types that we use and it is not very clearly done yet. To make that sort of art and craft, a viable opportunity that is shown. So people understanding different types of graphics. They are put off by other ways and it is not clear what to do. I am not a User Experienced person and dont have the career you have in this space so i want to make an invitation to anyone in the User Experience base. Im not claiming the unity game environments are the place to go. That is untested and im not the person to do this. I hope we get to Work Together. They need to be invited into this picture but it hasnt happened yet. So many things crowding my brain i could use one of your decisions to figure out how to get through it. I have been working on the responsible innovations and the last talk i gave, i said i was going to start using responsibility because what are you proposing . Are you making it responsible . Thats the only reason it needs to exist and a lot of things you talk about came together, the portions we are working on. I have a technology area, we are saying just use that. It is really good engineering practice and good decisionmaking and the question is how do you decide. I was interested in your talk because i was thinking about how you make the comment about technologists who have taken over. The way we designed the economy how do you make a dent in that structure, these amazing tools to the same people for the same outcome so if you go with outcome they dont change and people dont get the place at the table to change the outcome. Your given amazing tools to create the same outcome more delicious in a way but in a larger sort of way. This is what i am thinking about. There is a lot there and you are doing amazing work. I want to respond to one point. The reason i believe in this is it is making the invisible visible. Even if we get bad actors using it, it invites them. I would love before we made any government decisions that we insist on somebody drawing a decision model and have a Collaborative Team with multiple races, genders and ages that say they are agreed to that model. The executives i talked to the loudest guy in the room gets his way or who can tell the story and i think we have to combat that in the way we do it is by taking the invisible and making it visible. What you are saying, the challenge is to figure this out. When you have 5 perspectives you are talking about because thats one of the approaches we talk about. It becomes an overload. We get overloaded by these variables and how do you say this is a synthesis now to the point the loudest and richest or whatever person doesnt say we gave you all platforms and you said your piece but this is what we are going to do. Really good point. Let me speak to one aspect which is a principal. The main thing is read the book and it will answer your question. One of the best practices in this space is the outside of the box versus inside the box. You talk about the technology, the agentbased system, dont let people talk about the math inside it, you will get overloaded. Information hiding is another good point texture printable, focus on the interface definition. We dont need any more insights or answers. We have an awesome lot of scientific results that are sitting around unused because no one has connected them to the action to outcome change. We can get overwhelmed. If we keep people focusing on that we can overcome that. There are rooms we go in that we talk in Different Directions and we draw a map that shows how you are thinking and there is a relief because they dont have to keep it in their head. It is rendered in a picture. A couple more questions. What do you need to know . That is a 140 page book. You had an approach. This gets from the normative side of intelligence and theoretical approaches and being a technologist i have a bias towards that. Do you see any intersection or a need for them to Work Together . Lets look at the behavioral economic space and look at a cognitive bias we might make . The behavioral economist fits into the diagram somewhere and will help us learn how when we do this step or when this is true that will cause that to be true so the way i see the expertise areas, they informality different understandings of how people work into the picture. How a company will behave that becomes pretty important. To implement, i often see the decision which is when i realize it is not necessarily inside the approach you are taking and it helps you to understand the outcome. What is that book weapons of mass distraction, and algorithmic model, chapter 2, a great teacher, it is opaque. They dont know why. If they built a decision model that said here is the variable and how the prediction will be used in the larger context they could have done that much faster. If we understand the context in which ais are being used it is not perfect but at least makes it visible and subject to critique and we continue to impose all the best engineering practices around the context of the ais that we use. Thanks for the question. The idea of researching the side work. I wonder if you could talk about conflict and the role it might play in studying outcomes. Who made the decision to define the action and experienced in this methodology what do you do . In many situations, outcomes that appear to be in conflict actually arent. The whole purpose was to resolve conflict. If youve got different opinions of the actions we could take and actions we are trying to achieve and you capture them, ai and some of this technology can find a holy grail, a set of actions, because we are better at doing this and understand these links and at the same time arguing with somebody, having to keep complex links in our head and dont want to admit we cant keep complex links in our head so far back on arrogance and assertiveness and yelling. When we dont have to do that we have a map and it is not you against me in our opinion but you and me working on a common model. Lets join together to get a shared view. This kind of map facilitates the process. Great question. When you draw a picture of their mind that is great. A i is in the conversation. Makes you more open to the future. A wonderful addition. Last comment from anybody. Thank you for the decision to be here today. I hope the positive outcome succeeded your time with negative outcomes of your time and effort. How we make decisions together i often think it is difficult to get people out of their houses to engage with each other. We do need to continue this conversation, thank you for bringing us together and thank you cspan for being in the background, thank you very much. [applause] weeknights this week we feature booktv programs showcasing what is available on cspan2. Books and reading, pamela paul of the New York Times book review offers thoughts on how to get children interested in reading books. Marion will explain how our brains process reading print versus digital media. Bookseller and publishing executive james mustang on the 1000 books he says a person should read in their lifetime. Watch booktv this week and every weekend on cspan2. Television has changed since cspan began 41 years ago but the Mission Continues to provide an unfiltered, we brought you primary election coverage, president ial impeachment process and now the federal response to the coronavirus. You can watch all of cspans Public Affairs programming on television, online or listen on the free radio apps and be part of the National Conversation through cspans daily washgt