University of oxford. His areas of expertise are everything from war theory military ethics especially the ethics of remote and autonomous weapons. Hes a senior pilot with more than 1400 pilot and Instructor Pilot hours and many flown in of major u. S. Combat humanitarian operations. He currently serves on the air force staff, so staffs, Artificial Intelligence, cross functional team. But, you know, the more we see u. S. Military involved in other parts of the world, the more we see the use of drones and other remote weapons. And so now a good time to discuss whether that is moral or. So please join me in welcoming joseph chapter. Thank you, tony, for the kind introduction. Thank you for being here. This is really a privilege. I would be lying if i told you that i expected someday to write a book and to be able to talk to folks like you about it. I never thought that was going to be the case. This is really exciting. And to do so at this Historic Place is Something Special for me. Also i would be remiss if i didnt mention that president carter wrote a New York Times op ed in 2012, in which made it very clear that he had qualms about the quote unquote, drone program. And so im excited to bring some of those questions up and maybe hopefully to address some of the concerns that he expressed. So i think ill start by talking about a period of during which i was writing this book. I think it was about 18. I walked into the family room where my kids were watching tv. They were watching paw patrol. I dont know if youre familiar whenever there a problem around Adventure Bay these pups save the day. And i saw that one of the human characters in the show was flying a remotely piloted aircraft using a camera onboard the aircraft to try find a lost hiker in the mountains. I could swear i heard this child in the show say the word drone. And i said to my kids, did they just say drone on a patrol . And my seven year old said to me somewhat condescendingly, yeah, dad, do you know what a drone even is . So lets start there. Do we even know what a drone is . I think i do. I think in a position to talk about drones, i know what they. But its harder than it sounds. And one of the reasons that its harder that its than it sounds is because there are so many misperceptions around these airplanes. And so before we even can have a conversation about whether remote warfare is moral. We have to have a conversation about what we mean, some of these terms. What kind of warfare we referring to. So ill give you just one example. I have nothing against the International Committee of the red cross. They do excellent work. This is just literally the first one that came up when i googled. But this is an article from the icrc on autonomous weapons systems. And presumably its going to tell us about the profound implications for the future of warfare. But the Art Department decided to give us a picture of an empty nine reaper, an empty nine reaper is not an autonomous weapon system. Theres nothing autonomous about it. Theres a human crew there, qualified. Theyre trained. Theyre certified. Theyre qualified to aircrew under the air force instructions that govern air crew qualifications. And there are some automatic of this airplane it can fly to point it can hold an altitude. It even hold a specific bank angle, if you like. But thats no more autonomy than we have any modern airplane, including the airplane i flew went on to get here this morning. And so we kind of a problem because our our minds, we have these heuristics built because we see this image of the mq predator or its successor, the nine reaper, over and over and over again, associated with things like autonomy. Im going to get to that a little bit more in a moment. But what i want to emphasize here is that the weapon systems that i have in mind, the predator and reaper, theyre not autonomous and theyre not by Artificial Intelligence. So what are the. Well, the question remains difficult to answer. Again, in 2018, i had a friend who assumed command of the newest United States air force empty nine reaper squadron. So i flew across ocean. I was living in the uk at the time. I flew across the ocean to be a part of that ceremony and the local headlines ran words like this drone squadron activated. And as you can see here, this is an actual picture of the aircrew. They went from being a detachment to being a full fledged squadron. So they peeled off the patch, signifying the detachment put on the new patch, signifying the squadron. It was a great day and i was really glad to a part of it. Two days later, you might not remember this date, but i certainly do. On december 21st, 2018, i back across the ocean. And as we approached Gatwick Airport in london, the pilot came over the mike and said on, fortunately, were not going to be able to land at gatwick to drone activity on the airfield. He said, ive been flying for 18 years and i have never seen anything like this. So we thought we might be able to divert to heathrow. That would have been nice. That was actually closer to my house. But heathrow was full of all the airplanes that have already diverted to gatwick. So i got a free trip to manchester and a four hour train ride back home. But the next day these are the kinds of that i saw. Gatwick drones, ground flights. So this word drone, were asking it to do a lot of work. It everything from fully autonomous killer robots that dont exist. It covers the mq one predator and empty nine reaper that have been a mainstay of Us Air Force Operations for the last 15 or 20 years. And then it covers 300 quadcopters that you can buy on amazon or anywhere quadcopters are sold. And the reason that matters to me is because unlike these air crew members who are trained and certified and have to meet longstanding standards for for air force, the person who bought that quadcopter ruined my day by having me have to divert, but also costing hundreds of millions pounds in the in the Airline Industry that. Person had no certification they didnt need any special training. And as i said, it only cost them a few hundred bucks. So theres a huge difference to me between the kind of people that are involved in Us Air Force Operations and piloted aircraft and then the broad swath of people who might be behind one of these less expensive pieces, equipment. And so as we try to hone in on what it is, were actually talking here, i want to away from autonomy, but i also want to recognize why we tend to think that these things are more autonomous than they are. So i dont think its the right view, but its an understandable view and part of the reason for that is because you look the shape of this airplane. This is the mta nine reaper on the left. Nine was initially operational, capable in 27. So that was just six years after the predator was first armed with the hellfire missile, that first shot was on the opening day of the us war in afghanistan. So 2000, when we get the predator, 27, we get the reaper. And this is the reaper. And i want to point specifically at that nose in the front on any other airplane, what would you expect to see at that bulbous nose in the front . We would see canopy glass or windscreen, almost every airplane, almost every picture of every airplane that you have ever seen. If you look at that spot on the airplane, youre going to see canopy glass or windscreen and i think weve trained ourselves over and over and over and over. Weve seen hundreds of thousands, maybe even millions of different pictures, airplanes in the course of our lives and at the front, the airplane, canopy, glass or windscreen. And what that represents to us, i was just at the airport this morning. When you look through the canopy, what do you see . You see the pilot the person who you know is responsible for that airplane and everything on board. And on this airplane, we dont have canopy glass and we dont have a windscreen. And i cant look through that glass and see the eyes. The person whos responsible for that airplane, i might trick myself into thinking, well, maybe there is no one responsible, but im here to assert to you that there is someone responsible. Its a qualified aircrew member thats been certified to be responsible, that airplane and everything on it. Just humor me. Theres two thought experiments that id like you to consider. The first, i dont know if youll be familiar with this. As you might imagine by now, i watch lot of cartoons. The the disney pixar movie planes. Every one of those planes has eyes. Where are those eyes on those cartoon . Theyre always on the canopy glass, the windscreen. Right. So even the animators at pixar know that as the ancient proverb says, in the case of airplanes, the are the windows to the soul, the eyes glass is literally the window through which i see human person, the soul thats responsible for that airplane. Second thought experiment. Just imagine we are now in the age of Autonomous Vehicles. There are not that many out there on the roads. Theyre not in every city, but that theyre in your city and youre standing at the crosswalk first. Imagine just a regular automobile, good Old Fashioned car. Its got the windscreen. You look the glass, you see the person on the other side. When im at the crosswalk. And im trying to determine if that car going to stop for me. What do i do . I look through the windscreen and i make eye contact with the driver to see if they can see me. Right. And we share a little bit of a moment if we dont make eye contact. Im waiting till they come a complete stop before i cross right. And in fact, we can be thrown off on that. As i mentioned, i lived in the uk as much as it was difficult to learn to drive on the left hand side of the road. It was even more difficult to learn to look at the right, the correct side of the car because the car approaches the crosswalk. Im constantly at my right side of the vehicle, which of course is the passenger seat. And its pretty unnerving to see an empty passenger seat or even worse, to see a persons dog. But now imagine now that theres an Autonomous Vehicle, right . The autonomous has no need of canopy glass or windscreen. Right. It senses the world around it by use of cameras and light and radar and some other things. And it positions itself in the world through those means. It doesnt need the glass. So imagine that an Autonomous Vehicle has, a completely opaque windscreen, imagine that. Its this composite grey that we see on the reaper. And now imagine in the crosswalk when that vehicle approaches, the crosswalk, are you going to step out in front of the vehicle . Maybe theres a person inside, maybe not. Is that a technical system or is that a techno, social . Is it just a piece of machinery . Is there a human operator behind it . I think without realizing it . These are all the questions come up when people who havent seen the of a predator or reaper cockpit see this image. So this is a lot of table setting. Theres a lot of work to do to get to the ethical. But i think this is where we need to start these airplanes are not autonomous. Theyre flown by a certified and qualified air force aircrew aircrew. Okay. So if if we can if we can dispatch with the idea that these systems might autonomous, then we can start to ask real substance, tough questions about how does this new technology or in my view, this techno social system. Its a system that consists both of a piece of technology and human. Cruise how does fit in with the long history of warfare . There are lots of ways we can ask this question. We could talk about moral justification for killing in war. We could talk about moral psychology and how that applies to war. Here, im only going to focus on the warrior ethos, the warrior ethos in the western tradition. To us from homer, thats a statue of there on the left from the library of congress. And homer gives us two warrior achilles and hector. And of although we have these two warriors, its achilles, that emerges in the tradition as the archetype of warrior, one wonders if thats because achilles one but we wonder whether achilles is the kind of person that we should want to emulate. Is achilles the kind of person does he have, the kind of ethos that i would want . Young lieutenants in the United States air force to emulate, for example, i think probably not. As you might remember, the iliad opens with achilles wrath or achilles rage, depending on the translation and his rage, his wrath, his personal sleights of honor drive the plot in several instances. Reason hes enraged at the beginning of the book is because his honor has been slighted. He expected a war prize and at the last minute was taken away. His honor was hurt. Thats the thing that drives him to violence that thats the thing that motivates him. And i dont know that achilles is the kind of person that we would want to emulate as a as a kind of warrior ethos. We could look at hector on the other side. Hector is much more human than achilles is a scholar, is more intelligent than i have pointed out. We get glimpses of hector with his family in a way we never get glimpses of achilles with family. We get glimpses of hector with his family. In one classic scene, hes still wearing his his uniform. Hes wearing his armor, including his helmet, and he leans over the crib to see his baby. And the baby starts crying because the babys scared of the armor. Right. And hector thinks, how silly of me. And takes his helmet off. Right. Its a very humanizing moment where we get to experience hector in the fullness of his personhood. That never happens with achilles. Achilles is a warrior, and hes only a warrior. And i spend so much time on this only say that again and again and again. The scholarship on the warrior ethos traces the warrior ethos back to achilles. And i want to challenge that a little bit for a couple of reasons. First, because when we think about the warrior, we tend to focus on the fact that both achilles and hector were to risk their lives. They were willing to pay a great sacrifice toward whatever their ends might have been. I would argue that they both have very different ends in mind and. So this warrior ethos grows up to this idea that. What it means to be a warrior is the willingness to risk ones life. The willingness to face risk in the face of an adversary, maybe even the actual imposition risk in front of the adversary. And so we think about in our modern time is the archetypal warrior. Well, its the person whos willing to to go out there and face the enemy gunfire at normandy or, you know, its the person whos willing to raise the flag at jima, people who are willing to face great risk to themselves in battle. I think thats fair. I think thats right. Think if we look at the history of warfare, we do see that. Warriors are associated with this willingness, face risk, but i think theres Something Else operating there. First of all, we should distinguish between actually facing risk and the willingness to face risk. And i think this really matters. Speaking of normandy, a few years ago, my wife and i were able to tour the beaches at normandy and the american there. And we had walked through the 9000 headstones at normandy to, commemorate the us forces who were killed, not just in that battle. But throughout the war. And as we as we got back to the tour bus to go back to our next stop, i was in line with an older gentleman who had a world two veteran cap on and there were just not that many World War Two veterans around anymore. And so i made a point to strike up a conversation and i had a fascinating conversation with a man named bill. And bill told me that on dday his job as a 17 year old was to work the night shift at a baltimore newspaper and function of the night shift was to sit there, wait until the teletype machines, the stories that are on the wire. And his job was to determine whether the story sufficient enough to wake up the editors. And so he learned about in that room on the teletype machines. And surely that was newsworthy. He woke up the editors. And so he told me, thinks hes probably one of the first people in the United States to learn about the invasion because he had that job on that day. And by the end of the he had gotten his mothers signature on his paperwork so he could enlist in the navy as a 17 year old. Training takes a long time by time, he was trained up to go to the european theater, that war was over. We had achieved in europe. And so the redesign needed his ship for the Pacific Theater and the war ended soon thereafter. But he jokes with me that he got to the pacific just in time to earn his World War Two veteran cap right now, this man, bill, didnt face combat risk. He was never actually at he never engaged the enemy, but he definitely displayed a willingness to face combat risk. Right . He definitely through the steps that one must take in order to become eligible for combat risk. And i think that willingness really matters. And of the reasons that i think that is because of all of the rpa, the remotely piloted aircraft crews that ive talked to, i have never met a Single Person who has said, you know, i volunteered to join the military. Were an all volunteer force. So everyone who joined the military volunteered. I volunteered to join the military. I raised my right hand. I swore an oath to support and defend the constitution of the United States against all enemies, foreign and domestic but then i volunteered to go to the predator or the reaper, because i really didnt want to face any combat risk. That seems unlikely to me. I have friends who volunteered to go to the predator reaper because were airsick or because they were tired of travel schedule and some other airframes or they wanted to produce more operational effects. They felt like they were stuck, not close enough to operation, but ive never met anyone. That said, im unwilling to face combat risk. Therefore send me to the predator or reaper. So when we trace this line through the history of warfare, one of the things we should recognize is this distinction between actually facing and willingness to face risk. And i want to put the emphasis on the latter rather than on the former. But theres a second thing that we can we can mention here, and that is that all of the honor and glory that achilles is concerned with, it just might not sufficient to define what it is to be warrior. And i think as we read the memoirs of of wars over time several wars, i focused on the last 100 years but im sure there are others we constantly we consistently this this remark that even though there are glorious things in they they are far to too minuscule to justify the of war. Ive given you just a few quotes here but Oliver Wendell was served in world war correct and served in the civil war and he was on several occasions and actually the first time he was shot, he was in Field Hospital and he was convinced that he was going to die. And he wrote a letter to his mother, in fact, saying that he had resigned himself to death. Of course, he and he went on to become the Us Supreme Court justice. Later in life he was giving a speech at harvard. Its one of the most famous speeches that hes given and. He says war when youre at it is horrible. And dull. Its only when time has passed that you see that its message was divine. So hes willing to admit that theres something divine war, but only in retrospect, only when can review the Lessons Learned, not the in the midst of the blood and fighting. Ulysses grant certainly was a veteran of the civil war, but long before that he was a lieutenant in the mexicanamerican war, and he wrote his wife, julia. Wherever there are battles, great, many must suffer. And for the sake of the little glory, i do not care to see it. So hes recognizing that there is some glory to be had, but it isnt worth fighting. And finally an unnamed french soldier in world war one writes, there will never be enough glory to cover all the blood and all mud. The french soldier right before that line, he calls the people, the generals and the policymakers who got the european powers into world war one. He calls them criminals. He talks about this this crime of war theyve committed. And then he recognizes that there might be glory, but not enough to cover all the blood and all the mud. So achilles, motivated by honor and glory. I dont think thats enough. I dont think that gets us all the way there to what it means to be a warrior. Certainly theres something about risk, something about the willingness to face risk. But i dont think that gets us all the way there either. I think the third thing, the thing that were missing is that there also has to be a willingness to take human life on the other side of that. And that goes under. Under. Remarked. Underresearched. People dont talk about that as much. And i. One reason for that is that in the long history warfare, these two things almost always go together. Willingness to face risk and willingness to take life. And in the predator and reaper world, were asking people to separate those two ideas. We have predator and reaper crew members at this point, just reaper crew members of the United States air force who are willing to face risk because they they took the oath. They raised right hand. Theyre not actually going to face risk. But we are going to ask them to take human life. And i think thats a crucial element to understanding the warrior ethos in the way that we should. So if theres one holdout, if we can all agree that war is too muddy, too bloody to be justified, glory and honor, there must be Something Else that justifies war as a just war theorist. I have strong views about. Ill sidestep them here. Lets just imagine that there are just causes to go to war. And it has nothing to do with. Honor and glory. Even so, there holdouts who think there is at least one place thats still glorious in war. And those are the pilots, right . Because flight has always been glorious. Flight has always been this dream that we meant to achieve. We achieved it at kitty hawk in 1903, and then it became a fixture of warfare, starting in world war one. When i was an officer trainee at boston university. Several years ago, i not only had to be familiar with John Gillespie, mcgees poem high flight, but my peers and i had to memorize it. He that ive slipped the surly bonds of earth and danced the skies on laughter. Silver wings. Sun word. I have climbed and done 100 things you have not dreamed of. And so maybe flying airplanes and war is still glorious. That still has the honor that achilles was after. Thats still still divine in Oliver Wendell holmes. His terms. But i hasten to add that John Gillespie mcgee wasnt writing about wartime. He was tragically killed in a training accident before he ever got to war. He was writing about pilot training. He was writing about flying in a peaceful sky. And that. I agree is romantic. That is glorious. There is a dream. In flying in a peaceful sky long. After John Gillespie mcgee died, i flew the six texan two and the ti 38 sea talon in pilot training, and i lived gillespies poetic dream. I did the things that he described in the poem and it was every bit the dream that he suggested. But i theres a theres a threshold that we have to cross as aircrew members when Start Talking about combat operations. And thats the time to put away the the poetry of the means and adopt the prose of combat ends. And so my view here is that there might it might be the case that when we put these cockpits on the ground, when we have air crew members, fly these airplanes from the ground rather than from the air, we are we are robbing them of some of that dream. But its in the service of our our military service to the political community. And thats just a necessary condition success. We have to do what we have to in order to in order to achieve our ends and to say, no, no, we need to hold on to that dream. We shouldnt have remote because we should let these pilots fly in their airplanes. That would be just like achilles saying that and honor are justifications for war. And so i just dont see it. I just dont see the argument working out. So i agree, gillespie on his dream, but i think theres Something Different about war. Okay so if these weapon systems are not autonomous and and if were convinced that glory and honor are not justifications for war, then we can finally start to hone in on the humanity behind these systems. Theyre not autonomous. Theyre not flown by computers. Theyre flown by people. So what is the Human Element thats at work in these weapon systems . There are several stories i could tell you, but ill just mention a few. We could about moral psychology. We could talk about virtue. We could talk about moral justification. And in some of these stories, theyre all interrelated. In researching for the book, i was allowed to go sit with crew members as they flew combat missions in the cockpit or sometimes called the ground station. And so i didnt know what was going to happen on those missions. I didnt know if they were going be exciting or boring to me to be frank about it. But it was a privilege to be able to watch the crews do their work and so i was on headset listening to the crew and to everyone they were talking to on the radio. And in this one instance, the pilot was talking the jtc. Thats a joint terminal attack. Its usually an air force airman, although not. And they obtained this joint qualification to be able to say cleared hot on the radio so this is the air power advocate thats embedded with the ground force that can translate ground speak army and marine corps speak into air force speak to translate the Ground Force Commanders intent to the aircrew and the pilots. Now talking to the to the jetpack and the pilot has found some disturbed earth in a field and shes not sure exactly it is and she describes it to the jetpack and the jetpack is convinced that its in order to keep in mind the jetpack and his have been being fired at by mortars several days. So he is he is up to find mortar tubes and destroy them. And so this pilot and the sensor operator discussed the issue, discuss what they thought was under their crosshairs and said no, it just doesnt look like a mortar to the much more likely scenario is that its a shovel because this is a field and its disturbed earth. So it looks like someone was doing some shoveling. They finished the task and they put down the shovel. And so the jetpack wanted this pilot drop a bomb on the mortar team. And the pilot said, no, and we can do that under us military doctrine, because under us military, the pilot follows an power chain of command up to the combined forces air commander and the land force follows a chain of command up through the land forces component. And so when the when the army or the marine corps joint correction, Ground Force Commander asks us for a weapon as the United States air force for a weapon, its not a direct order. Theyre not in a position to provide with direct orders. So its really more like both people need to consent. The pilot has to to release the weapon and the Ground Force Commander to ask for the weapon. In this case, the pilot was uncomfortable it and said, no, thank you. Now, i would argue that that is human judgment operating in the cockpit, that would not have happened if this was an autonomous computer driven system. The data could have just said, go and the system would have gone. But because we, a human in the seat, the human can execute human judgment. I thats important. Even though that story that i just described is never going to make the news. Youll never read it in the newspaper. Youll never see a headline. And there are a thousand such stories like that where air crew members are using their human judgment. And you might disagree in in this case, you might side with the data and you might with the pilot. But the point is that there is a human judgment at work and these decisions. And i think crucial and fits in with the long history of of air power, the video that youre seeing on the left here. This is predator video from the of 2002 on a hill called tucker, ga. Afghanistan in 2001. As i mentioned, the us invaded afghanistan on october sixth, a pilot named Scott Swanson, the first hellfire missile off of a predator. That was on the Opening Night of the campaign. But it wasnt Close Air Support. He wasnt supporting troops in contact. He was trying to destroy a high value target. Actually, he was to destroy a vehicle in the convoy that belonged to a high value target in the hopes that that would draw the high value target out. Five months later, theres a predator providing overwatch for on this mountain, on this tucker gar hilltop, and this predator, unlike the previous, is not armed. The hellfire is new to the predator. They had to expedite the Testing Process to get the hellfire on the predator. So not the tail numbers have a hellfire missile. So this is stuck just watching. It cant do anything. It doesnt have a missile. Well, the this was a special force ingress. It was a seal. And theyre their their air power advocate was, an air force airman named john chapman. They took heavy. The enemy was far more dug in than they had expected. It did not go well. Chapman was injured and he fell, lost consciousness, and his teammates assumed that he was dead. They quickly exfil they quickly exfiltrated the mountain top. And because they thought chapman was dead, they the risk of going to get his body was too high. So they left him and then he woke up and then he fought on by himself. Another hour. And at the time he was awarded the air force cross is one of the highest ranking medals. One can be awarded posthumously. He was killed after that that our, in fact, according to some accounts, was killed because he had he had taken several bunkers from the enemy. He had driven the enemy out of several bunkers. He took up one of those bunkers as a fighting position. And he have been able to stay there and fight on longer. But according to some accounts, when the army sent a Quick Reaction force to support this effort, he came out of the bunker to, draw enemy fire so that they wouldnt be able to shoot down the with the army folks that were inbound. So he was awarded the air force cross several years ago, then secretary of the air force Deborah Lee James read an article, airman magazine, that said that an air force airman had not been awarded the congressional of honor since vietnam. And so she that page out of the magazine and handed it to an aide and said, go look into this. How come an air force airman hasnt been awarded the medal of honor since the vietnam . And so they looked over several sets of records to try to find medals that might be able to be to be promoted to the of honor. And chapmans was one. So he he has now been awarded the congressional medal of honor, one of the most important pieces of evidence. That decision was this video from predator at the time. Thats why its been declassified and why you can find it on the internet. But imagine imagine that the pilot of this airplane who if i have the historical pieces right, is also Scott Swanson, the pilot who fired that first missile. Right on the opening day of the war. Hes got an armed predator and he fired a missile. Now hes watching a fellow airman fight for his life and theres nothing he can do about it. Try to imagine that feeling. The next airplane. Once he got out, he ran out of gas and to go back to the base, he was replaced by a different pilot and that pilot was flying an armed predator. So when that army Quick Reaction, Quick Reaction force got to the hill. Another jay tech, gabe brown was able to call in the first ever Close Air Support strike from a hellfire missile and they were able to defend the Friendly Forces in that strike. Heres why i tell you the story. When we think about the ethics of remote, were often were often to terms with the headlines, with the strikes that have gone badly and will be the first to admit that several strikes have gone badly. And im not saying that those strikes were morally justified. Thats not the argument. The argument is for every one of those strikes that you might see in the news, there are countless times that the predator or reaper crew did, the right thing produced the mission objectives, what they were asked to produce and did so with extremely low civilian harm. And imagine if Scott Swanson had a missile on his airplane that day, right . The story would have been very different. And john chapman might have made it home. Right. So when we think about the ethics of warfare, we cant just think about the strikes that have gone badly. We have to think about all the things that would have been different had we not had these airplanes. There are. People i have met them who believe the world would be a better place had it never for remotely piloted aircraft. A big question. I dont know the answer to that question, but i know if were going to take that question seriously, then we have to think not only about the strikes have gone bad, but also all the work that the crews have done to produce justified military aims with very low civilian harm. So what comes next . I think ive made the case the human crew is central to, these airplanes and i can imagine ive heard people say to me when i say these airplanes are not autonomous and, theyre not driven by Artificial Intelligence. Sometimes i get the response. Yeah, not yet. But soon they could be. Thats true. Soon they could be. And in that that composite bulbous, maybe instead of a satellite dish antenna, maybe we have some supercomputer brains. Someday but what i wouldnt want to do is that when that day comes, when artificial or autonomy is sophisticated, that it can autonomously control a reaper. Or wouldnt it also be able to autonomously control other stuff too . I have there a picture artists conception of what a Loyal Wingman might look like in the Us Air Forces approach to Loyal Wingman. That would be a traditional f 35 Fighter Pilot controlling, a swarm of, say, four, ten or 12 autonomous, Loyal Wingman. If the age of Artificial Intelligence is upon us, if were going to have autonomous weapons systems, sure, it could look like reaper, but it could also look like the Loyal Wingman. But for that matter, it could also look like a traditionally piloted f 35. We can have an Artificial Intelligence system and put it on that airplane to support the pilot and the pilots. So what i dont want to do is imagine this throughline that goes from predator to reaper to the age of Artificial Intelligence. I dont think thats what its going to look like. I think we need to learn the lessons we can learn from remote warfare, from predator and reaper. And then i think we need to have a separate discussion about autonomy in Artificial Intelligence. I dont think theyre as closely related as some people do. So everything ive said up to this point seems a little bit retrospective. And thats true. It is retrospective. I am looking backwards at two decades of remote warfare, but i dont want to leave you with the impression theres nothing here for us, for the future and the reason that i say that is because the emphasis, the ethics discussion on which ive very little i meant is on the distance, right . The reason that we can separate in the warrior ethos, reason we can separate the willingness to face risk and the willingness to take life is because of the distances involved. The reason have to ask questions about whether these crews their job. Seriously, i didnt say much on that but thats one of the arguments that have a playstation mentality or the reason people have that concern because of the distance weve had, weve learned a lot about the psychology of remote warfare. I havent said on that either, but i could add to is grounded in the distance. The initial assumption that these crews would be would be psychologically unaffected by their work was grounded in fact that theyre at such great distances. How could they be so emotionally invested . And so all of these questions about distance, those arent questions that go away at the end of the predator and reaper era. Those are questions that are going to come. And i think theyre going to come up more frequently. Let me just give you a few examples. If what were worried about in the ethics of remote warfare is the 7000 miles, which is the distance from nevada to afghanistan if thats the kind of distance that were worried about, then think about Something LikeCyber Warfare Operations or a cyber Warfare Operator might operate from the United States and produce effects in cyberspace that have physical effects on the other side of the. Or think about hypersonic flying at five times the speed of sound continents and over oceans that, too, is going to involve thousands of miles worth of distance. Or imagine, as i said, artificial and autonomy. We know we might imagine that if 35 pilot with a human pilot board staying outside of the enemys threat ring and sending some of those wingmen forward to a place thats more dangerous even that pilot will be at a greater distance than will the autonomous level wingman. So these questions about remoteness dont go away. I think they they actually get more important. And so my hope is that will be able to look at the Lessons Learned from from 20 years of remote warfare, ask hard questions about what elements of this really are ethically significant, and then try to apply some of those lessons to the next 20 years. Thank you all for here tonight. And do we have any questions to to mention about being 7000 miles away from afghans does that mean that theres one drone operation . So great . The question was, is there just one Operations Center these these airplanes . Because i had mentioned the state of nevada. So i have mentioned at the top, but just in case theres any doubt the views expressed are my own and dont necessarily represent the department of defense, though i am an active Duty Air Force officer, so there are lots open Source Information about various places that the air force, these airplanes out of. Im not in a position here to list them all. There are several. Yes, sir. You talked and about distance being issue, but it involves more than just the predators. What about the person . No relationship. Between the and the potential victim, because its thing if you are flying a fighter jet that sends a missile some distance or punching a button sends a missile, but its another. Youve been watching the family that youre going to perhaps attack. Thats right. So the question was about the distance relationships and how that applies to the aircrew that might be on one side of the world and the person under the crosshairs on the other side of the world. And thats one of the things that we had to learn the hard way. A community that people do get invested in the work and that can at a at an emotional psychological. So not only is it case that theyre witnessing whats happening on the screen. So its its not like you know the the remote warfare of the 1990s if you will was Cruise Missiles. But when the Surface Warfare officer launches a Cruise Missile from a ship, theyre not actually seeing the impact. Theyre not seeing the missile explode. And so on the one hand, its true that were these crews are watching the video. Right. So thats one way that its a little more intimate. But we have that in traditional fighter planes. Also, the tv screen will be smaller and the image might be a little grainier. But we share that in common with the traditional fighter and bomber crews. What really it different is the loiter time. So fact that these air crew can stay on station for eight, ten, 12, 21 hours really provide a lot of insight sometimes about how just how human the person under the crosshairs is. So different people react differently to that. But we certainly have learned that some members have had a hard time with some of those issues. I didnt get into it much here tonight, but but the the remotely piloted aircraft community, if will, is several different commands. But that community recognized. Probably almost 15 years ago that this was to be a psychological, emotional challenge. And so at creech air base, for instance, they established a Human Performance team and at various times theyve had slightly different professional cadre of professionals. But at the time i visited and interviewed folks, it was a physiologist, a psychologist, a chaplain. And so the idea is that with their powers combined, they should be able to provide support to the in the kind of emotional spiritual, psychological space. And even when they first established that team, they decided it really wasnt effective because those members didnt have the same classification readings, the crews. And so the crews didnt feel comfortable telling them what had happened on the mission because they didnt know if they were allowed to because of the classification constraints. So now that Human Performance team is read into all the same classifications as the crews, so they can just walk in the work centers, they can walk up and meet people and build that way. And the the stories that i got from them, from the members of Human Performance team when i interview them, is that its really come a long way that they really have deep going to get support from the Human Performance team. So weve come a long way, but we had to learn the hard way. You you also mentioned that there can be differences of opinions, a request to going ahead with a strike that happen often. I dont have any data to to but its its certainly unheard of. One story that i think captures this the best is a friend of mine named, dan, had been following a high value target for several weeks and. So hes only an eight hour shift. Theres a 24 hour cycle. So there are other crew, other crews that are supporting that same target. But every day he comes in and for roughly 8 hours, he follows his high value target. And every day this high value target leaves his house, puts a kid on the back of the motorbike. Theres a football, you know, soccer pitch the home. And so theres a bunch of kids playing soccer. And so he goes and gets one of those kids, puts him on the back of the motorbike and goes a mile to the north to the homemade factory, because thats what hes responsible for in the terrorist organization. And so it became pretty clear that hes using those children as a human shield to to do the drive to the north. And so, my friend dan is watching this play out. And then one day after three weeks of this, he shows up and starts to get the intelligence briefing and says the Ground Force Commander to take the shot today. And so starts asking questions of the relevant echelons today. Why does it have to be today . Why not yesterday . Why not tomorrow . And he never a satisfactory answer to that question. And he knew that if hes asked, take the shot and if theres a kid on the back of the motorbike, hes morally responsible for that. So he decided that he wasnt willing to take that shot. And by the way, they did the Ground Force Team did consult with with legal. So it wasnt a question of whether it was illegal. The determination was made that that the proportionality calculus would have been satisfied. So although it would have been tragic, it would have been a justifiable civilian casualty because the military value of the target was so significant. Im to discuss that, if you like. But the point that it wouldnt have been a war crime, it wouldnt have been illegal. Its just that dan didnt feel comfortable with it. So the point of this whole story is that dan has the authority to say to the Ground Force Commander, im not doing it. Doesnt feel. But then because these cockpits are on the ground, the Squadron Commander walked into dans cockpit and said, dan, are going to be all that. Youre going to be able to take the shot today. And what strikes me about the story is that the Squadron Commander could have said, dan, take the shot. Well, now we in uniform code of military justice, territory because now that is his commander in his chain of command him a lawful order. But the commander do that because when we put these cockpits, the ground, we built in some flexibility and the commander recognized that. So he said, dan, you going to be able to take the shot . And dan, if they could give you a reason why it has to be today, i could do it. But in the absence that reason, it feels arbitrary and im not comfortable with it. And so the commander said, all right, i dont have anybody else to fly the line today. So stick with it, i understand youre not going to take the shot tomorrow. Im going to get somebody else on this line. And so that day, for the first time in three weeks, the high value target come out of the house and the next day, Squadron Commander found another pilot who was fully briefed it wasnt a secret. He knew. He knew what he was getting himself into. And he said he was willing to do that. And that day, for the first time in three weeks, the high value target did come out, did get on the motorbike, but didnt put a kid on the back of the bike. And so the timing, the complacency worked out to where that pilot was able to take a clean shot against the high value target. But i tell that story here because emphasizes the fact that that air chain of command, thats thats thats not in negotiation. Those are orders when it comes to the air power supporting land component, that becomes more of a peer to peer relationship. This kind of warfare sounds more personal. I think thats right. One of the things that i think it took a long time to recognize is that if you look at the the development of technical im sorry for those that couldnt hear the question was this feels more personal. This kind of war feels more personal. So if you look at the Technological Developments in the 1990s, especially in the United States air force the the tasks were to try to find and destroy and that was true in the first gulf war and it was true in in kosovo. And it was true throughout the 1990s. In fact, the air and stated mission was to do time targeting and single digit minutes. So find a target and put a bomber within minutes or less. But all of the target sets were machines. Now certainly if you blow up, you know, lets say an iraqi tank in 1991, certainly youre going kill the people inside. Thats thats going to happen. But that was never the intent. We werent we werent trying to kill those people. We were trying to destroy the tank. And what happened september 11th is that we transition to a force that was in the business of targeting people. And and i think it took us a long i think we reeled from that transition for a long time. And so now we were i would like to think were were coming out of the post911 wars, counterterrorism, counterinsurgency. There are lots of people in the dod who are talking about future conflicts. And it almost feels like a reversion to that 99 just discussion about how do i destroy the adversaries machine . And so i dont know if we ever if we ever got to a point where, we really understood all the nuances of that shift. But but we did learn to do it effectively. And as i said, to deal with some of the psychological, emotional implications of that. And do you see things like drones becoming more prevalent as a weapon warfare . So the question is whether i see these airplanes becoming more prevalent in warfare, its really hard to and people in the United States force have very different opinions on that. Its i think this is just my opinion. Its a question of what one chooses to emphasize. So if you look, the recent National Defense strategy, that emphasis is on you know great power competition, nearpeer threats the pacing threat is china thats what that document says. And so when people think about that kind of conflict, were very much in the were looking forward not back, its going to be a contested environment, meaning, you know, unlike iraq and afghanistan, theyll have the ability to shoot down our airplanes. And so we might need airplanes are more sophisticated than the predator and reaper theres another line of argument that says even if we need to think about those things terrorism isnt going away, that that operational concern ended. So we still need airplanes like this. So what i think well see is increasing automation, not all in one go. Were not going to get to Loyal Wingman and i had up there overnight but i think youll start to see processes on board airplanes become more and more automated to the degree that maybe potentially eventually were able to take a person out of it then and then its a drone, but its different from what ive been talking about here because now its its an autonomous airplane opposed to a remotely piloted one. For me, i have one last question. What is your answer . The title of your book . Yeah, its i was hoping you wouldnt. The question is, what is the answer to the. I think that these are weapons. And so i think that whether the use of a weapon is justified or not depends on what you do with it. And so i think it is incumbent upon us as as the United States of america to impose on ourselves on how we decide to use force. And as a just war theorist, i think that last resort is a crucial of what they call you, said bell in the of the decision to go to war and. One of the main one of the main arguments, the most significant arguments against remote warfare is that it creates a moral hazard . It provides an incentive for Decision Makers to resort, to force. Its cheap and easy, and i dont even mean monetarily cheap, although these are cheaper than, you know, f16s and f35s, but its politically inexpensive because the chances of having casualties on our side are much lower. And so we create a political incentive to resort to force, even when maybe we shouldnt resort to force. And i think the solution to that isnt getting rid of these weapons systems. I think its imposing selfdiscipline on our on our foreign policy. But thats just my opinion. Yes, sir. So from kind of a historical perspective, you know, sixties cold minutemen, sailors, crews, bunker in american sailor, we get it. You know, in order they got 90 seconds, they go through the procedure, they push the button, obviously more distant than the experience of. The drones now. But at the other end ive seen some stuff related to like boston dynamics with their robots being basically warriors again, to the question do you see a limit of where you know a robot. One guy controlling 20 of them running through forest or back at a desk. I mean, yeah, it is you know, its escalation. Yeah, thats a great question. So the gist of the question was remote warfare has been around for a long time going back to the Intercontinental Ballistic Missiles in the postnuclear era. And so that seems like its been around a time. But then we have these contemporary developments like the the boston dynamics robot dog and, you know, robot, other robots and everything and so were putting ourselves on a trend line that were going to have a single operator for several, maybe several dozen of these systems. And so that was the gist of the question. So i am concerned. So one of the reasons that i take view that i do is because the humans are so involved, intimately involved in all the decisions that go into the use of force. These weapon systems. And as we start to kind of aggregate those systems where, you know, maybe youll have for eight or ten or 12 systems under one human control, theres no way that that human is going to be as intimately invested in each of those scenarios or each of those operations. And so i do have a concern about that, actually. I worked with i worked with some researchers on a project, and we were looking at how humans react to the kinds of moral dilemmas that can come up in remote warfare. And we just had an offline discussion. I was surprised to find that there proposed solution just as an idea. What if we intentionally pixelate the image before the strike right so we now have High Definition cameras which is far better than what you saw in that video. But what if the time of the strike we pixelate the image so that the human operators arent face to face with the human toll that causing . And my view on that, i dont think thats the right move. Dont think thats the right direction. Right. I think we should should do whatever we need to do to build emotional resiliency in the crews so that can deal with that that trauma, that stress. But i dont want to move to place where were where were constantly abstracting from. The human cost war, because the more we consider war to be costless, right, the more the more fail to appreciate the costs of war. The more eager well be to start wars. And i want to put us in that position. And there are questions questions. But joe, thank you very much is you have given us, i think, a lot to think about and. Think about it in terms of of context going back in history and we appreciate you being join me in thanking joe chhabra. Thank you very much. Thank you all very much. And if youll joinand welcome ts here to hear our talk by paul miller on his new book the religion of american greatness. I am mark tooley, president of the institute on, religion and democracy and of Providence Journal of christiana and American Foreign policy. We welcome all who are here, all who are this event live on, facebook and twitter and i, Audie Youtube all who will be watching this on cspan book tv. Were very grateful for the presence of their crew here this ev