Scene from the love drones must seem like an angels of death. The gods can see you. All the time. A toy has turned into a deadly weapon. Has this become our god. Televisa the white city so far away from and yet so near to war at the beginning of our journey i want to visit a country that is mentally and often physically at war. That disappears a lifetime is a promise without a thought yeah somewhere like we are in Israel Aerospace industry was one of the leading manufacturers of drones day the army and his two colleagues invented something here four decades ago they call themselves the three musketeers without it. And the three of you are this is your first three of you know that im sort of this is was the first that will be getting in seventy seven. And nineteen seventy seven where we began to develop it from scratch so been nothing was happening and we were thinking we knew with that we have to do a flying camera so we will begin to think about it and then this is it three years after we put it out. This configuration everybody a. Graphic of us it was really a joke because we were we were playing because the toys. Always money. With. The jet engines and we were really. Out of the time we were really it was a joke. Today then youll see that there was. A first increase to the platform because you know. When youre eating the appetite is coming with a buy it. We are allowed into the Ground Control station. Ok so im now im so frightened see. What do you feel when you sit down. This is not the fly doing ok i think you are very with the keyboard was a keyboard have to sit here or we did mouth. To mouth so now its i could really even see people exactly and i would i can go down with my camera with the camera on your mic and you can switch between day and night. I thing is it would be better if youre used to that i dont play video games but i think if youre used to said you can handle that thing better so basically you need the skill for a High School Kid knows how to play you we used to look in florida. Do you get like somehow close to someone if you if you follow him for what you. Know for me the objects are given the code names sometimes its in the names of banana and this is there the names i have no idea who he is. Family nothing. Thats why i can keep it professionally and objectively to perform my mission can you show us a bit how it looks like if you if you track and talk at someone how does it look like so where you can see in this video. It was taken during cast lead operation in gaza in january two thousand and nine as you can see here this is still dressed as an israeli soldier as you can see carries a firearm and have a back radio device looks like one of our soldiers hes also wearing a uniform. Uniform but after a short investigation. As i mentioned we can look at investigated tell get that he doesnt wear a helmet on his head and hes missing did something with his hands so we find out that hes preparing improvised explosive device. Looks like an injured person ok if you can see two legs and a body its actually a dummy. But. Hes hiding improvise its those explosive devices beneath the dummy this is not the behavior of an i. D. F. Soldier ok this is a gave off a terrorist wasnt explicit this is was an attack helicopter that we call the helicopter in order to attack the terrorist that is hiding here but since we didnt want him to hit the uninvited civilians the bomb here made almost not damage at all so he told the helicopter helicopter pilot to shoot again this time he aimed a little bit closer so the wall collapsed but the tail was syrian man alive so he called for a Ground Forces in other places there were in the house explode everything but here make sure that none harm will be done so on involved. I prefer that my mission is going to be to save lives. And not the other way around but the. Reality is really is not that simple unfortunately. At the border to gaza we hear shots. We are stunned by the surveillance devices balloons with cameras attached. Watching everything predicting everything a logic that does not prevent war. In july two thousand and fourteen a thirteen heavily armed attackers from the military arm of hamas crawled through a tunnel into israeli territory. Total surveillance and the deployment of high tech seemed to provoke arcane countermeasures. Where were this war game and. This is how it began in america since nine eleven the American Government has been deploying drones and other instruments more and more for surveillance and for targeted killing. The n. S. A. Of a home. About n. S. A. Surveillance and Surveillance Drones are to a certain degree a socalled response of challenge this challenge in this case. This means the attackers no longer wear uniforms or openly carry a weapon or launch attacks or move in a unit across real or imaginary borders instead they come from deep within the social space in the cities or towns or wherever thats where they operate and that means you cannot deter them. Like when you. So in consequence you have to act in a much more preventative manner if you want to stop them. But that means you have to know what theyre going to do. And you can only do that through dragnet surveillance and even if course you know there are political alternatives if our society were heroic one way you could say we dont want this sort of surveillance the probability that we might die terrorist attack is no higher than that of us dying in a household accident you know we accept that it was. But our society isnt that heroic finds were willing to take our chances with accidents and we accept them with sullen indifference from this but we cant accept this sort of terrorist threat post. And because we are opposed to roic societies we demand surveillance and Security Systems and including preventative ones. No if i know if i can buy fish by then you can only call drones cowardly if you are more willing to accept the risk of death and steady to name. This. If thats the case we have to accept that a post Heroic Society brings forth the post heroic weapon. But i dont and the drone and all its trappings post is simply opposed to relock weapon one has said that the weapon is the essence of the fighter yes and in light of that the drone and its deployment however its used is the essence of the post Heroic Society. Fighting by means of a monitor. Killing in the same way. We play or is it the other way around. But. I dont like that it was. All over the world any one second you know you could fill dozens and even hundreds of Madison Square gardens you know with the amount of people that are playing this game its incredible i mean its becoming like sports its people are earning a living out of it its very competitive and i think its great and its not something we ever imagined when we first started making this game. Even the advertising trailer for call of duty shows possible reasons for the games popularity it combines violence heroic poses and futuristic more technology. Than. It is do like you know yeah. Its funny because i remember just watching it remember so many of the stories that you know that happened when we were making the game and many fun memories trigger in my mind when i watch that. Its really fun going to work and. You know you see a lot of a lot of future type stuff where you get a lot of these Energy Weapons like laser guns and all these kind of thing and we wanted to stay away from that because. We feel thats sort of too little too Science Fiction for us. But it actually opened our eyes as to you know that restriction aside how how much is actually being worked on right now theres just some crazy stuff going on drones in particular. Its fascinating to see where this will go because drones now have these things called Mission Packages where you can actually autonomously program a drone to go on a mission completely on its own no Human Interaction needed and this technology exists today. You know the day when you will have a drone that can have a Mission Package to go somewhere target somebody take them out and then return is an incredibly scary world. To Paris Air Show is the Biggest Aerospace trade fair in the world and a marketplace for military machines. Wheres this development heading were hoping to get some answers. Please welcome to the podium the secretary of the United States air force Debra Lee James mann. Well good morning to you in usa you are looking sharp good morning everybody as i said yesterday we in the air force like to talk about Global Vigilance global reach global power but you cant get any of that without Global Industry backing us up and also without our Global Partnership so were very very grateful for all of that because you see collectively you and i all of us together we are all air power and today air power. Our is air and its face and cyber we are all collectively air power and keep in mind and spread the word air power without us you live is thank you very much. After months of trying an american film crew is allowed to enter the plant and general atomics as a german crew we constitute a security risk. This is the predator b. Aircraft you can carry three thousand pounds of payload beneath its wings another seven hundred fifty found payload in similar hardpoint. And let me say without reservation the future of remotely piloted aircraft is right and this company is represented above that in the last twenty five years we have logged over three million flight hours with our remotely piloted aircraft and its interesting to note that that curve is exponential the more we produce the more its flown in fact in that two thousand and fourteen we flew nearly five over five hundred thousand flight hours in one year alone. And i think its interesting to note that every second of every day there are fifteen seven of our aircraft airborne worldwide. Making soldiers into heroes has long been a tradition not just in america. His willingness to sacrifice himself is what makes a soldier deployable. What value do socalled soldierly virtues have in a future where on men machines dominate the battlefield. But their technicians we already have these kinds of people there in the air force and they scare me they frighten me these are people who have no ethics they have no morals they are amoral they are a political they have no real concerns about anything but the technology and stronger. So it can valley in california has produced thousands of these people i meet them i talk with them i see them and i understand them i think and it scares me they have no ethical compass at all theyre question is how do i perfect the technology how do i make the technology do what my customer wants it to do or what i wanted to do and how do i refine the technology as i go along there is no ethical component to their thought we are producing these people today in our universities in our corporations in our society and they are frightening people. If people no longer half ethics could ethics perhaps be built into the machines we fly to atlanta to the Georgia Institute of technology i have read that professor vonage i can is doing research on an Ethics Software for robots. The most depressing work that i had to do was studying Human Behavior in battlefield environments the battlefield environment brings often in many human beings in some cases the best i mean you can see noble examples these unfortunately are highlights or exceptions in many cases but often we see atrocious behavior literally atrocious behavior where noncombatants are slaughtered and justifiably in the battlefield reading and studying Human Behavior in the battlefield as part of the work that i did is what caused me to think that we can create robotic systems that can outperform human beings in this case they can act in a more rational i would contend that might sound strange but a more rational manner under these sets of circumstances without having fear of selfdestruction or anger or frustration imbedded within them to be able to come up potentially with better decisions for this. The real question is how can we take what human beings have already decided is ethical behavior and make sure that the robot complies with that so what we do is extract from those laws the principles that say youre allowed to do this and youre not allowed to do that we do that with our war fighters as well too we tell our soldiers youre allowed to do this and youre not allowed to do that they dont reason from First Principles in terms of deriving International Humanitarian law where in the battlefield theyve been told what is right and what is wrong and in essence were doing the same thing with the robot were telling it whats right and wrong to code in this particular case. Using a software called ethical governor the votes of the future should control themselves and develop a guilt sensor. In the scenario depicted here an unmanned probe craft is bad on a search and destroy mission. While performing its mission you know in manner of craft encounters an enemy convoy within the designated kill zone. The robot searches through its choice available weapons and weapon release positions for a combination that can simultaneously satisfy the allegation and the laws of war all striving to minimize civilian collateral damage. After Battle Damage assessment has occurred for about compares the actual damage yes make it prior to the engagement the resulting Battle Damage exceeds that expected by the robot going to have to compute a guilt value corresponding to the actual excessive damage incurred. Theres got value in the rod macqueen dibley plausible model is computed as a function of a range of articles quoting the military necessity associated with the target and mission the number of casualties including combatant noncombatant friendlies and the amount of civilian structural day. Image sustained. As a consequence when gold levels increase or as weapon systems are deactivated by the ethical adaptor relation to their destructive potential. The a. As always there are different perspectives. That if the map that of the camera from above and that of the phone camera from milan. Eat. My car cant be ethical or not my of it cant be ethical or not my robot cant be ethical or not it can be designed with the designer trying to be ethical or the user trying to be ethical but the machine itself is that it is a machine second it assumes that you are not facing a thinking fellow who will take advantage of that programming. You could build a awesome. Machine gun armed ground robotic system theres versions like this right now and one of the best counters to it. Will be a six year old with a can of spray paint. Because it will put an incredible dilemma on the other side you will either have to shoot. Technically an armed six year old or. Watches that six year old walks out. Phrase paint right over the sensors and defeats your super advanced robot. Thats the point is where where were in this space where i dont think you can just simply engineer your way out of an ethical dilemma. How would i decide. Like a machine. The machine can process all the available information at top speed. Im not that fast. What does it want. Nothing at all. It is sufficient. Is that what the inventor wants. Who knows. These machines will make mistakes they will kill civilians there is no doubt about that all Weapons Systems end up killing civilians the real question from my point of view and this is whats called a consequentialist argument or utilitarian argument is well they kill less civilians than Current Technologies and war fighters do. From my point of view if we end up with fewer noncombatant casualties thats a good thing. To my surprise ron arkin sends me to the aquarium in atlanta he tells me that he sometimes goes there with his grandson. Cohen. Hes particularly fond of the beluga whales their lightness their beauty and their playfulness. We project many of our longings on to animals something inside us would love to be just as free as we magine they are. Thanks to what use do we put these longings thanks what are we doing to ourselves. Thanks why are so many machines named after animals drones hawks predators we take their forms and abilities and transform them into Something Else thank you. Thank. You he has. The bully turn ourselves into Something Else in the end the bank. If as i firmly believe it is our imperfection that makes us human what happens if we try to eliminate this imperfection. We project a little bit further out here but youre going to see things like how you want to assassinate somebody you could send a swarm of insects size drones that have cameras on them for actual Recognition Software and used put all this stuff into the into the swarm and say go for it this guy and you know sting him with your cyanide tail or whatever it would be and then you dont even need boots on the ground. Zero to game shows as jones like flying insects anticipating a possible use of the technology for military purposes. In the way you are like lets say test fear dollars for the military itself it must be fascinating for them to see so its kind of. Close to reality well its incredible and you know im sat at home one day and i see i see an email pop up this is like a year or so after black ops two was being released and its from a former pentagon official who works for a think tank now the Atlantic Council and you know he said he wanted to talk to me about he said hed seen his son playing call of duty black ops two and he was amazed at how intricate and realistic the future storyline was for twenty twenty five and he wanted to talk to me to see how we would come up with that so he actually invited me to washington d. C. To be to go there and speak to him and some you know other people from the military the pentagon. How i came up with this this relationship what we might call military men is also now starting to go in the other direction where once it was the entertainment world that was pulling from war for its ideas were also seeing the military world pull from the entertainment world for its ideas and it might be anything from the actual technologies that they physically use so the control mechanisms for certain robotic systems are basically video game controllers why did they do that really two reasons the Video Game Companies already spent hundreds of millions of dollars developing the one that perfectly holds in your hand and the Video Game Company trained trained an entire generation of eighteen year olds on how to use it its intuitive to them now the right the only. One you know thats a good or it was triggering. The internet or the new the better to you and better the really the better the new. The and as you see these technologies make more and more decisions on their own the human role moves from being in the loop to as one u. S. Military document put it on the loop and then out of the loop. When will this take place. Dont ask me ask the head of the British Royal air force who said it will happen in his lifetime and hes not a young guy. How far his eye deficient intelligence been developed. In an article in the National Defense magazine i read that darpa the Defense Advanced ResearchPlanning Association partly financed by the pentagon as having robots built with real brains. James james if steve from the university of california is one of the scientists participating in this project. The idea is to build. Something thats like a human brain and not like a regular computer so we take another approach is to build a completely different system that will not in the end need tape or programming thats needed in the conventional computer. An artificial brain. Is a new paradigm in that sense which is a positive paradigm in my opinion but its like anything that has a big influence you can be used for chemical you know really you know purposes it would depend who owns it so would you trust your government to own as such a system that was about you know able to understand everything about you know. Making lee the n. S. A. Makes it may look like a joke right it would be able to process all sorts of information telephone calls everything but make decisions all i dont think you would want the government to have and then would you want big corporations to have it like google for instance they work on Artificial Intelligence. Would you want them to own it no you would but what it could truly achieve in the end. Could be. Way way beyond anything we ever could imagine maybe it would enable ozs through an implant to be you know have a super human intelligence for instance could. Can machines have a memory and make independent decisions in the end how far will their autonomy go. We are in the german provinces here we come full circle who were the thought that here of all places we would find one where Artificial Intelligence is not just a future vision but is actually being developed. Yvonne hofstetter is cofounder of the company terremark technologies in addition she has written a book about big data the title say this not unless they know everything. You tell mocked ignored just like linus on it and you know mark technologies is a small enterprise that only employs scientists mathematicians physicists information theoreticians and they only work on Artificial Intelligence we have a whole park full of Artificial Intelligence learning machine is distributed Artificial Intelligence to swarm intelligence to. Have against this its like dressing park this being a bit scary to peek inside so it inspires something called the frankenstein syndrome lines and. Last last if i said this is free and it works like i imagine it will can i keep it under control im twenty. On the hardest question there must be for imagine stock markets today imagine giant data centers with rex of computers and those computers are just blinking away every blink is a buy or sell in a matter of milliseconds and nanoseconds. This problem is this the problem is that incidents happen so quickly socalled flash crashes and a flash crash. The news sometimes reports that stocks of plummeted for no reason. That can happen so fast in this parallel machine world that the human eye can no longer keep up and enough people end up as helpless bystanders and im johnny smith. Military knowledge has entered civilian life and vice versa it was ever thus but the dividing lines between war and no war creasing lee disappearing. Surveillance spying these are terms that we associate with the secret service just as much as with social media. But what happens when things get out of control as in the financial market. What happens when war machine suddenly experience flash crashes. And mistakes like this be prevented. How does Artificial Intelligence work anyway. Yeah but i think doc on this machine working on making machines learn to analyze data. Yes i do and so we can see here in this first three d. Space how the learning machines discover structures in the flood of data. They learn to identify structures and. Once you see you know right after a while the algorithm starts to recognize structures you can see it here and unfit it begins to build this white area with black down here since like one in five thats infrared data the question is what does it say whats the result. We can see on this third image when i play it. You see what it sees you can we can make out some flying objects my guess is theyre fighter jets. And you have to program it in advance for it to recognize that pattern says yes flushed and as you can imagine with ai and this is where were heading it will allow us to drop a machine into an environment and let it work out what needs to be done what it can see. And what it should do autonomously. Then use the seamless sky thats pretty scary. To sit and talk safely sawdust were currently at a crossroads why do we have to decide what the human machine future will be like house machines are developing beyond mere tools kind of the x. Like i did today theyre moving towards increasing autonomy thats awesome its a synchronous these machines wont wait for input theyll take action on their own and one city deriving their data from the sensors that weve built into our lives once the internet the internet of things or if i think about smart cities streets and sidewalks. Then be a machine to bite us if we let machines become so autonomy us that they can eventually overwrite us to begin to steal become more intelligent than we are they might say the earth could be so peaceful the only obstacle is the human race you run for the lets get rid of it its in our time hes here. View of. This weeks highlights. Im missable the diesel or museum opens in paris. Livable quality like it is you. Know the. Thing with get the body painting by me and i keep that look for. Your romance thirty minutes w. Yeah i do my story and i think one day this war will be considered a cruel and unjust war but it will solution certainly all citizens with a grain every man woman and child is she not the only friend their homeland of the enemy invade just give it up for your bunch and no one wants russia here dont need to nuke which is the. Rebel against the mighty global news that matters. D. W. Made for mines. When history books are brought to life. Maybe the stories therein will get a rewrite. The story of the russian revolution. From the perspective of writers thinkers and to Covent Garden just what did it feel like to live in times of the revolution the. One nine hundred seventy the real october starting october twenty fifth two dublin. This is deja vu news live from berlin in the midst of the Catalan Crisis a stark warning from the Spanish GovernmentPrime MinisterMariano Rajoy says he will not without using constitutional powers to deny catalin his plans to split from spain meanwhile more protests