The Los Angeles Police department to court forcing it to release the details of its Predictive Policing Program theres 2 layers to predictive policing one is a community and a location based where algorithms are used and the Company Principal has developed that algorithm which was owned by Jeffrey Brown thing and was a professor of anthropology and has a long history himself how this thing was created on the on the feeds of afghanistan and iraq directly coming from the border from the war zones and the other piece is operational laser which is a person and a location based predictable policing program laser stands for los angeles strategic extraction and Restoration Program and the reason why its called laser is that the creators of lasers said that we wanted to go into the community with a medical type precision and extract tumors out of the Community Like lead from a decision thats where they came up with the act and thats how they came up with the acronym as people are tumors the exact track that i think is not really. What credible and laser claim to offer is a one stop crime prediction shop the pitch is to tell police not just where crime will occur but also who might commit crimes in the future. The l. A. P. D. Was using these technologies to decide where to deploy their police patrols. Focusing resources on socalled crime hotspots like by these. So this is all the hot spots for a particular time period hot spots are created by the algorithm the prep for longer where they use the information long term crime history or short term crime history and then they create these 505500 square foot hotspots on what basis how are they deciding this so the world to put it very bluntly theres a lot of pseudo science and now its being presented as these computers are really snootful and they would predict when a crime may happen. But predictive policing doesnt just flag up a place with laser it also sticks to a person the l. A. P. D. Maintain something called a chronic offenders bulletin these bulletins are undisclosed reports on socalled persons of interest people the Police Believe to be likely to break the law. This risk is calculated using a points based formula based on data from Police Records field interviews and arrest reports this is pulled together and scored by algorithmic software created by the defense contractor pal and here a company with close ties to the u. S. Military. So how do you get yourself on to the laser system so these are the things that identify these risks so if youre stopped and a field interview cards filled one point so if you know there is it or if the police stop stop youve got a point one point immediately youre going to point this individual was stopped the same day 3 times so the 3 and some 3 points right there if there had been a previous arrest with a gun 5 forms if you had any Violent Crime 500 parole and probation is 54 and and identified as again as gang affiliated 5 point. When it comes to the chronic offenders bulletin points can mean prison but its not just about locking people up for hemant the data suggests increased Police Attention at the borders of a historically deprived area called skid row which helps keep the poor contained from the more affluent neighborhoods nearby. So this is like a beachhead so think of the defense of financial district yet from poor people you know when you talk about hot spots you know you will see the dirty divide how the proximity of extreme wealth and extreme poverty coexist right here about 2 blocks from should take a walk absolutely. He was going oh man i am doing good to me general. Secretary of. The building right there. I meet Steve Richardson who goes by his street name general doe gun hes a former prisoner and skid row resident who now works with the coalition campaigning for greater protection for the local community. Say you guys have been doing work on this predictive policing stuff right is what does that look like out here on the street to people who live here so predictive policing rolls out at a lot of way because i mean skid row is ground 00 all experiments that happen you know so these poor folks of course so all a little programs l. A. P. D. Spy programs everything that they come out with is 1st tested right here they say 1st last the safest cities just right here was growth 110 extra police to skid row make it the most oldies community not only in america but 2nd in the world to baghdad get all kind of patrols on skid row so we got the cops on motorcycles we got regular cars we got. We got detail cops theres all polies in like a 15 block area what are cops on horses right smack in the middle of the house you know they have no i think the fans continue to come out here from a lot. About 80 percent of people here are black right about 80 percent of people suffer from something. A disability maybe physical you know semi or mental and all of us is full of. The most arrested person on skid row was a woman 8 and moody sousa arrested under the 80808 times for violating 4118 right 4180 days is up when this bill called to say you can sit sleep a lie on public sidewalk so our only crime was she was homeless and have anywhere to go and was forced to sleep in public space she got arrested 118. 00 times for being 108. For just for just being in public space and it was all over you know based on a lot of predictive stuff like that and the point you you joe gone and you have and are making is that this is a practice that goes way back right over policing in this Community Goes back decades and then that information from that then gets fed into the computer and the computer turns around and says well go back and do some more of the same thing right now and the computer before the information gets in the algorithm is designed for policing so the algorithm would create outcomes that an agency wants to achieve and this is really the key point and the outcome that the agency wants to achieve in this community is cleansing and damage when. We walk further along the tents begin to thin out as do the local residents gathered on the sidewalk were its obvious were approaching the outer limits of skid row the hotspot boundary hammond had pointed out earlier. This is like if on the storm a host of hot spots that a person from skid row would be walking into and this is where you will have more policing waiting for people who are for him than waiting for people to give them tickets waiting for people to throw them against the wall right. For people who intimidate and harass and demand to believe the neighborhood. But few weeks after we left skid row the l. A. P. D. Announced that it was canceling the Laser Program the pushback worked police admitted the data was inconsistent but the l. A. P. D. Says the predictive policing tool pred pull is still in operation. So lets think about the incentive structures with some of the predictive policing tools that weve been talking about what does it say about the incentives and the problems were going to have with these tools that youve got counterinsurgency software then essentially used for Law Enforcement purposes i hate to have such a sinister. Interpretation but i think its about opening up new markets to sell this software to 0 and Law Enforcement in the last is you know been a great market for lots of military technology is quite frankly i think that theres actually the opposite incentive to get it they have the incentive to get it wrong Predictive Policing Software has an incentive to make the sale with police so their incentive is to is to make predictions that are as close as possible to what the police already believe is correct so given that its really hard to know. If ai has been tried on representative data or or not if we have real reason to suspect for example that there might be bias than isnt there a question about whether the system should be used at all well i think thats the fundamental issue is that were seeing the deployment of all kinds of automated decisionmaking systems or ai over we want to kind of characterize it and we dont know the effects until after the fact after the damage has been done is primarily how were learning quite frankly about what doesnt work and i think it goes far beyond bias i mean were talking about aggregating data about us Building Data profiles that for close certain types of opportunities to us and whats more dangerous i think in the digital age about this is that you know in the 1950 s. If you tried to get a mortgage you were you were black and try to get a mortgage at a bank and you were discriminated against you were very clear about what was happening that discrimination was not opaque and when it moves into a Software Modeling system what instead you have is a banker whos like you know im sorry dr noble you just cant have it and i dont really know why and so that lack of transparency is one of the things that i think were kind of trying to contend with here and this just becomes a wholly normalized process we dont understand or with you know the the models for actuarial science for determining whether youre going to pay more insurance for example because you live in a particular zip code doesnt even account for these histories of racial segregation housing covenants real estate covenants so just because we look at the zip code that doesnt tell us about this long history of discrimination that has sequestered people into particulars of codes those are the kinds of things that i feel like over time become harder and harder to see i think one of the things that i find. Worrisome is that we talk about data being collected for these kinds of systems and for the most part they just collect of some completely different purpose it just happens to be there in policing data is created by the police doing what they do theyre driving around theyre stopping people there occasionally arresting people and so forth that data gets produced and then is used in a predictive policing model its not collected for the print predictive policing model thats a 2nd order effect thats used because the data is already there and it turns out that it is a terrible way to predict where future crime will be because what police do is not collect a random sample of all crime they collect the data they can see this is true in most of the places where people are applying i think it is useful to detect where bias is happening and simulation can be important that i think thats true however it doesnt necessarily allow people to have again this conversation that i have been discriminated against its just sort of leaving the expert analysis to make that discovery when in fact there are a whole bunch of people that wanted to be homeowners or you know wanted to move house and they dont really understand why these decisions are happening so as a Data Scientist whats your take on this how do we build a kind of test for when its appropriate at all to use Machine Learning and when its not the question should be who bears the cost when a system is wrong so if we unpack a particular system then we say ok were building a Machine Learning system to serve ads and the ad that were serving oh this customers searching for sneakers but we served are boots ad. Oh dear we are wrong here no one cares thats a meaningless meaningless problem the consumer could care less we get along ads all the time were trained to ignore them lets compare that to a system which makes prediction about whether or not someone should get credit. In a credit based system if were wrong the consumer who should have gotten credit doesnt get it or the consumer who should not have gotten credit does get it in both cases in particular in the case where someone who should have gotten credit does not get it that consumer bears the cost of the air she doesnt get whatever it was that she needed the credit for to buy a house or a car or something the company that failed to offer the loan may bear a small cost but there are a lot of customers so they dont really bear much of a cost and so when the customer bears the harm. We can predict that the harms will be greater because the people deploying the systems a little incentive to get it right. We know that if people of color are over police or poor people are over policed and over arrested they are also likely to be over sentenced. Machine learning isnt just used to predict crime its also used to decide whether a person should be given bail or how long a sentence a prisoner serves. Criminal courts in the state of florida and use a predictive Sentencing Program called the correctional offender management profiling for alternative sanctions compass. In 2016 journalists at the us news outlet pro publica investigated compass and discovered an apparent racial bias at the heart of its algorithm. Probably did. Investigative report and one of the things that they found in their hand a review of all of their records was that africanamericans were twice as likely to be predicted to commit future crime i found it incredibly interesting for example the story of died one of the reporters told that there was a black woman a young black woman who had taken a bike and one of her neighbors front yards and kind of ridden it around and the person here on the bike said bring that bike back and so she did it but a neighbor called the police on her and she spent 10 days in jail and the Compass Software gave her a score of 8 out of 10 that she was likely to commit a crime again and that and they looked at white man who had a history of Violent Crime of history of being in a. Now out of jail and the software gave him a 3 year so he was more likely to be replaced. Once again the bias in society was revealing itself in the machine. Let me take. Like no place on. The brain. Underneath the strongest fastest and most skilled. Nations the consequences in stadiums that are to. Discover our newest destination defeat the womens world cup france 29. 00 t. This is a dialogue reading about it for us and staying at it on International Media and on t. V. Why should we stop this conversation with skepticism because theres a lot of it on my everyone has a voice we are being taken advantage of just because we are Small Community without any network to seek help join the global conversation announces iraq all they want to do is start of the same kind of debate that we have here in st. True confessions more thorough not a big cleanup but not all right cynical example of communist propaganda and to put it in the bay area one i would want to do it the whole in 2010 aljazeera access to north korea to investigate be a legit use of biological warfare by the us during the korean war rewind revisits dirty Little Secrets on aljazeera. And im talking about how the top stories here on aljazeera the United States has released a video it claims shows Iranian Revolutionary guards removing what it calls an unexploded mine from the hole of one of the tank and u. S. Extra state might pump says explosions were carried out on thursday and only iran had the weapons in the expertise to do it the japanese owner of one of the ships said he doesnt believe in mine all to people who were involved in the holes and more than a good many the crew is saying that it was hit by flying object theyre saying that something came flying to put a bomb on the side of the boat is something we are not considering iranian president Hassan Rouhani has said that the United States is pushing an aggressive stance that cannot be tolerated he was speaking at a gathering of asian leaders and. The government of the United States over the last 2 years is using economic and military capacity and is creating an aggressive approach the United States has stepped over all the norms and regulations of the International Community and has created new threats for the region and the world a military spokesman for yemens truthy rebel group is warning civilians to stay away from airports in saudi arabia and the u. A. E. But how would he says that Radar Systems have been targeted saudi arabias ports near the border with the the head of the operations at airports military sites will continue as long as the boy in yemen goes all. Homegrown governments may be wavering in its support for a new told to allow extraditions to Mainland China another mass demonstration on sunday is planned to stop the bill becoming law and advise it to government lead to carry law and says legislators should abandon discussions of the bill because of the level of opposition to it. London call it as a rule that Julian Assange will face a 5 day hearing in 2020 a whether he will be extradited to the United States or not wiki leaks founder appeared via video link from the london prison where he 7 a 50 week sentence for skipping bail military leaders in sudan admits they ordered the dispersant of the sits in protest and cutting which led to the killing of dozens of demonstrators protest as managed to get round an internet blackout to release new video of last weeks crackdown at all me h. Q. Agenta spokesman expressed regret for the deaths of protesters. Are you up to date with the headlines hit on more news coming up right after the big picture. The. You know. The risks of bias baked into Machine Learning arent just confined to law and order. Upon release prisoners must reintegrate into a world that is increasingly automated. Today for them as for you and me opaque computerized systems will help decide their access to state welfare to private finance and to housing take Credit Scores these are