Transcripts For SFGTV Police 20240703

Progress on enacting the lead program and obtaining funding for it or revising, revisiting that strategy . Its a strategy that is has been talked about. We havent made any movement with a formal reentry introduction of lee. You know, i am a proponent of lead. I think it has value. I think part of that. But even that theres a Law Enforcement component to that when its done the way its designed, you know, people are given an option. Youre either go to treatment or, you know, the hammer is waiting on you and the hammer is incarceration. And that is one element that were not necessarily fully offering right now. Right when you have the option on, i mean, treatment especially Harm Reduction, that is actually the model, right . That if you have an opportunity to access treatment in lieu of and isolation, punishment, probation, parole, whatever the case may be that those folks are then have the agency to self motivate into treatment and yet thats not necessarily the strategy, as i understand it. Its that that were using. And i, i commend the department for being out there and sometimes reversing overdoses. I mean, i think thats a positive number. And thats something that helps balance out the challenge. But at the end of the day, i think its been said before, thats not what our officers are necessarily here to do. Right were were trying to improve our Public Safety outcomes. Weve done a great job. I think , and it doesnt get talked about enough that our Violent Crime numbers are down right. And we are facing other issues. But i think that not having that focus solution outcome oriented investment is really going to get us to that place. And as Vice President carter overstone said, there have been other solutions proposed. And i just i feel its were stuck in a place of kind of just, you know, hoping that this strategy is going to get us to a to a better place. And it just it seems like its also going to damage a lot of lives in the process. Yeah. Thank you. And i do, i, i respect that. I do. I do want to say, though, i want to highlight the fact that we are at the table really working hard with our Public Health officials, people that are assigned to this, you know, drug Market Agency coordination center. Theyre there every day. People all working in the service side of this. The homeless and supportive housing, because a lot of our people that were talking about are unhoused and Human Services agency trying to connect people back to their their support systems. So theres a lot of work being done. You know, in collaboration with what were doing. And i dont want that to be lost in this conversation because i know when we only talk about the rest statistics, whether it be drug users or sellers, were not talking about that piece of what this is about. This this being this Agency Coordination center. Theres a lot of work being done and were trying to move the needle on bringing these services and so its not all policing, but that takes collaboration and. To Vice President carter stones comment about the report, some of the people who had part in that report are working with us to try to make this work. So i just want to make sure that we dont lose sight of that. Its not all about the arrest. I know thats what the questions that were asked, but its so much more to this than just that. And were trying to bring all this stuff together. Thank you. Thank you. Sergeant, could we go to Public Comment for members of the public that would like to make Public Comment regarding line item five, the chiefs report, please approach the podium. Id like to use the overhead again. My son, aubrey abkhazia, who was murdered august 14th, 2006. I have this where mayor gavin newsom said i know who killed her son. Mayor gavin newsom said thursday. Da know who killed her son. The police know who killed her son. He can name individuals and their addresses. I bring this with me all the time. Of all the names of the people that was involved murdering my son the last report we talked about how much money has been paid out for the unsolved homicides. And then you put on your agenda about about, about the unsolved homicides and finding someone else to pay. I mean, finding someone else to pay tipsters to solve our cases. And still, i dont know whats going on with that. If you hired anyone else to solve our cases, i bring these pictures of all of the unsolved homicides. We all know about them. Theyre not solved. Again i bring my me standing over my son. This memory will never leave my mind. I come here every wednesday to bring awareness to the unsolved homicides. This is what the perpetrators have left me. A lifeless body. Im still looking for someone to solve these unsolved homicide ads and pay tipsters some kind of money. Again, i bring up, we got to look back at our history so that we can move forward. That is including my son. What can we do about it . I come here every wednesday. Its not putting on a show. Im not here to entertain. This was my child. This is our children. Something needs to be done. Thank you. Members of the public that have any information regarding the murder of aubrey abacus, you can call the 24 7 tip line. At 415 a5754444. Hello. Good evening, commissioners. Good evening, chief. I firstly want to thank you for that report youve given. And while you all were discussing it, i did want to mention that seattle bill passed with a majority of measure 110 and 2020 and what the measure 110 did. Was it decriminalize the possession of small amounts of hard drugs and establish a Drug Treatment Program funded by the marijuana tax. Now, the Police Officers can only cite the users and has been an abysmal failure in 2021, there were 745 documented overdoses. Well, in the year later, in 2022, there were 13 and nine 1309 an overdose and no Treatment Center. So i think the problem we face here in San Francisco is the board of supervisors is responsible to get the Treatment Center and its sfpds job to ensure we get the user from point a to point b and ensure the safety of the community. But were expecting the sfpd to do the boards job and their own. So like i said before, thank you, chief, for the work youve done so far. And we recognize the work and we want you to keep up with it. Thank you. Hello everyone. My name is joe cirillo. Im a licensed clinical social worker here in San Francisco. I actually came to talk about the dolores hill bomb because im a skater, but i will say really quick, thank you for reviewing whats really happening on the street. Im a therapist on the street with the Harm Reduction therapy center, definitely seeing lots of overdoses. So just really putting my support behind more coordination Rehab Centers can be like waitlists of up to like two weeks. So while people are waiting the arrests dont seem to be helping folks. And yeah, hopefully there can be more resources put into support and medical support on the street and therapy. But my other hat is im a board member of the San Francisco skate club, which is a after school program. Um, i just wanted to read a few points that our members wanted me to address to the board. So we know that a lot of, most of the charges for the 117 folks who were arrested in july at the dolores hill bomb were dropped. But we just wanted to see if the city and the commission can bring a little bit more clarity to whats happening to those folks who were charged, especially the youth, like what happens with their mug shots, their fingerprints. What are the implications if theyre arrested or cited . Again and just one other point tied to that, if i can use i dont know if this is still working. So basically, i dont think itll show up very clearly, but the San Francisco skateboarding laws and the enforcement around the laws dont seem to be updated in a lot of the City Government websites. Im just pointing out the board of supervisors analysts website says that traffic code section 100 says that skateboarding in most areas, aside from skate parks and aside from neighborhood sidewalks, is illegal. Ive personally been. Theres no further Public Comment light on him six directors report discussion an report on recent activities and announcement Commission Discussion will be limited to determining whether to calendar any of the issues raised for a future commission meeting. Executive director henderson. Thank you. So we have opened up over 600 cases so far this year. Thats a jump in the number of cases that have come in this year from last year. Weve closed. 552 cases, which is more cases than we took in at this time last year. We have 304 cases that are still active and weve sustained 44 cases so far this year. Weve also mediated 31 cases and we have 22 cases. Who is investigate . Actions have gone beyond and a nine month period of those 22 cases, 17 of the cases are told and we still have seven cases that are pending resolution from the commission and 85 cases that are pending a resolution in with the Chiefs Office in terms of the past two weeks, weve received about 36 cases have come in since the last Police Commission. When i gave this report and the largest percentage of cases that came in, which is 14, were for allegations involving a neglect of duty, meaning allegations where an officer failed to take a required action by complainants. The full list of all of those complaints can be found on our website in terms of the precinct, the largest number of cases in terms of complaints came in from the past two weeks. The largest from Central Station. We had five allegations that came in regarding Central Station and those allegations were for complaints alleging, again, that officers failed to properly investigate or to take action when information was reported to them. The full breakdown by every precinct, including the airport, can be found online for the allegations that have come in in terms of outreach, we conducted a mediation conference. Well talk about that next week. Ill have a summary for you guys outline the information that we presented in terms of the audit we received an exemption from the Police Commission on 8. 10 for calendar year for 2022 activities. And i just want to clarify, youll see the information in the audit, but im just reiterating it just to remind folks on why we needed that exemption, because there were no investigations governed by 8. 10 and 2022, and because revisions to 8. 10 are underway as well. So youll hear more about that as that unfolds. We have nothing in closed session this evening, but present in the hearing room today, in addition to myself, is chief of staff sarah hawkins. Also present is senior investigator brant bagian and also present. Is one of our attorneys on our policy team. Jermaine jones. For folks that may wish to get in contact with dpr for any reason, you can contact us at sf gov. Org or you can contact us. At 415 a2417711. Ill reserve te rest of my comments for the agenda items as they come up that concludes my report. I thank you, director henderson for that report. At our last meeting, we agenda and discussed. Sfpds auditing practices as it relates to the audit of traffic stop data and director mcguire presented on the Current Practice rs which are just just checking when theres a when theres an entry made thats not completed. The audit flags it, but it doesnt actually look for any signs of, for example, data falsification or anything else that would go to the integrity of our stop data. I just wanted to i know this is an issue that youve spoken about and something thats at the core of a dpas work, so i just wanted to invite you to, to, if you had any thoughts on sfpds current auditing practices and how they could be improved. Yeah, i think you raised some of the really important issues on the inquiry about falsification or Data Analysis and those were specifically cornerstones i think we were missing. I did see that report and i reviewed that document that was presented on the what was referenced as a small data. And i have a number of concerns. And again, i cant discuss any of the pending cases is that i have specific only or those specific investigate actions. But in reference to the overall information and the bigger issue, which is what i think youre asking me about, i , i think theres some real challenges that exist that are actual even from the audit that we were presented small a audit from the charts. It still shows a number of outstanding entries that go back as far as 2020. I real concern about the information that identified in the charts that were numbers were deleted. Thats a third of the cases were deleted. 13 of those cases from 2020 are still in progress. For me, these are just numbers on a page. There is literally no analysis or explanation that speaks to the issues that we were investigating and continue to investigate as it relates to stop data. Its not in compliance with any of the audit steps that were committed to under collaborative reform. Um, the cri or even the bureau orders. Thats not what at least what i saw. Thats not what this is. That doesnt speak to what was mandated or to the data that we requested or tried to raise and evaluating the stop data we has raised the issues about stop data and the reliability of that data for over a year now. But we have i havent seen a change either in the response or in the data. And this this report did not answer any of those questions as well. Ive said this before that we are a Small Department and we have limited staff. We are working diligently on the individual cases that we have, but we have real concerns as we have real concerns about the information that we have that speak as well to the individual discipline without having a broader understanding or a full measure of both scale and scope of what the problems can be. Weve seen that problem in other jurisdictions, and im not saying that we have those exact same problems in San Francisco, but we have the same indicators of those problems here in San Francisco. But its difficult to drill down on individual transgressions without a broader understanding of more data and broader analysis. And those are the two things that we need. I would suggest, and i think were moving in a direction where the best option would be a review, which is comparable, but Something Different from an audit. Weve done audits in the past as everyone is aware, award winning, i might add, and so im going. To begin a review too, which is separate from an audit because its a little more nimble in terms of the analysis. But that that review is going to call for us to either work with outside agencies and or with the department, but will absolutely need more access to data and analysis, which is what i think this is where i think this process and where the project needs to go. So thats what id like to do. But id be calling or asking for someone from the commission to continue that work with us as we unfold. Failed to confirm or deny by the problems that i think weve uncovered thus far. I know commissioner benedicto has worked with our audit team extensively. I dont want to expand his role anymore or yes, i do. I dont even need to dance around. It is we i think thats thats what i would like to see. Thats what i think would be helpful in addressing this issue. I think the individual cases that come up are a real concern. But if we really want to speak to the problem in ways that confirm or deny the problems that weve seen in other jurisdictions is i think thats the step that needs to take place. I dont know if that answers your question, but thats thats very helpful. I think that i think that does answer the question. Thats helpful. And i think, as we said last time, we i think we need to agendize this issue again to coalesce around a specific course of action and the thoughts that you laid out certainly makes sense to me. Um commissioner walker. Thank you. Now i have a question on i think weve talked about this before and i, i think it would be helpful when we look at this in light of sort of the discussions that happen every week around should we be arresting drug users or what should we be doing . The information that were getting around complaints that come in . I would like to see kind of the complaints around that issue of people calling, because theres folks who are doing stuff out in the street. And when officers come, they dont respond. I mean, i would imagine since ive been on the commission, most the largest percentage are in action rather than action. And so thats real. I mean, theres a lot of what police are doing, especially as we ask for Community Policing that is about crime prevention, not Crime Fighting per se. And so, you know, its the if the complaints are around a Mental Health crisis or if theyre around drug use in the streets or if, you know, the drug use accelerates to Something Else and i mean, i think we have had a policy in the last few years of not doing anything, letting people be and making sure there was no violence happening. But i think that the last few months, there has been an effort to stop the action. Yeah. So i would say and i think which is why i report those statistics as in as much detail as possible. And i try to make sure that its clear that as a disclaimer, these are the allegations because these those exactly are the things that people are calling to complain about. But without the specifics from the subsequent and following investigation ones that come from it. Yeah, but this you know, the commission asked me to report on these things. Thats kind of why i do it. Its harder for me to drill down on in all of the specifics, although i do to 100 on everything that comes to and through the agency every week. And thats why i put it online just so theres complete transparency about what people are asking for here with some of the specifics. And i focus on just the general ones. But you are correct that just in terms of a review, and i think this is part of what you were asking, is what were seeing is that that trend in terms of folks complaining that theyve called to have someone arrested or that theyve called to have a Police Report generated for something and its not happening, continues to be the top allegation. So separate from all of the other analysis and complaints and investigations that come into the agency, that has not diminished what ive seen in terms of diminished or changes week to week is the percentage get higher or lower, but still remains the majority. Its rare that that that that allegation or that complaint is not the top complaint at the agency. I think its a its part its a relevant part of the conversation we have about alternatives. And i think knowing that knowing the need out there is going to help us find Better Solutions as an alternate response when we can. So i dont disagree and to me, when you guys are having the conversation, the balance on the other end of the conversation is just this, that the calls are still coming in. And i think the department, you know, as the chief has addressed in the past , the calls come in every day for everything. And these these allegations, i think, reflect that the majority of those calls that come not just to the department, but to the agency themselves, asking for a demand for services, a demand for a response with out a broader breakdown of the specifics of what those calls are. But those come subsequently, later, and then you see them in my further investigations and then those are broken out quarterly and annually. I mean, i think its also important to note that the care court is starting up around the severe Mental Health issues and the referrals from family and loved ones that that have more impact on the system. At some level, these numbers are a measurement of the need of that efficiency or if its working in terms of the publics response to it, great. Yeah. Thank you, commissioner benedicto. Thank you very much. Vice president carter overstone. I definitely agree with you. Director henderson, that i think that some sort of formalized review i think makes sense. Its something that that ive discussed with Steve Flaherty, who does audit a cpa. I think its an important an important specific step so we can achieve that transparency. I wonder, chief, if you had i know its being floated and talked about live, but if you had a reaction or wanted to respond to that, to a possibility of having to do some sort of directed review about about the about the stop data. Yeah or response, because i know we heard from director mcguire that one reason why the audits as they are right now are really only able to look at are so limited. I we talked about how theyre only looking at started and not completed. And one reason was that theres just one. So theres just not the resources. But if it were something that uh, to at least give us a snapshot of and better insight into what, you know, the scope of the problem is, because weve seen this in other departments. If thatd be something that youd be open to working with the dpa on. Yeah, im open to working with dpa on that. I just want to say also we have to sustain the effort. You know, i think mr. Rosenstein read part of the substantial compliance and one of the issues was we got to staff it. We have to staff this. You know, the audits are good. Theyre great. But audit recommends actions have to be implemented. And you all know that because weve been held to account on that and we have to staff it, you know, and thats kind of the bottom line. The scope is fine. I am open to that, to answer your question. But we have to staff this to where audits are sustainable because as absolutely it has to be an ongoing thing. Absolutely. And i think that they arent mutually exclusive. I mean, i think that a one time review that, as director henderson said, is maybe short of an audit. So it doesnt carry with it some of the same requirements might provide us a roadmap. And then long term. Absolutely. To add more to that unit sustainable, i think i think is good. I think then if im ill continue ill reach out with rector hendersons. Ill reach out to Steve Flaherty to see. And i think what would be, you know, i think that weve talked about this a lot, chief. I think that the system works best when dpa and spd sort of have a unified front and theyre collaborating on something instead of instead of in a more adversarial nature when it comes to policy changes. I wonder if i see i see director mcguire there and i want to director mcguire on the spot. If you could ask if we could work collaboratively with dpa to come up with some sort of a specific action proposal to satisfy what the Vice President has asked for. So we can present at a future commission meeting. This is the one time review proposal. Theres buy in from dpa. Theres buy in from sfpd. Theres this is the data sharing theyve agreed to. And so were not getting and if we could present that to my fellow commissioners for a vote and then that action can be taken. Yeah. I mean, im always willing to work with staff. Steve. Im go we go way back to the Controllers Office together and im also always willing, willing to work with janelle or whomever is appointed or assigned the work for sure. Perfect. Thank you. Director henderson. Yeah, i was just going to say, i think one of the big issues is just in speaking to one of the concerns that the chief raised in terms of personnel, a lot of this can go almost out. The majority of this conversation is really focused on access to data, less than the personnel to evaluate it. What specifically is a problem or not a problem . The issue is more access to the data and the raw data. Even for the small audit information that was presented, going through and evaluating that information is, i think, a big part of the solution that confirms or denies whether or not there are a pattern in what weve identified are clear problems, whether or not thats individual or systemic. Thats, i think, a big issue. I know you said you wanted to agendize the issue and we can come together then on what the plan is. But im mindful of limited resources , both from dpa. Were very Small Department in comparison to the Police Department, and im mindful of the chiefs concerns about staff and personnel for this work as well, which is one of the ways is one of the reasons, one of the very reasons why i think a review is the best option that is open to working with Third Party Agencies like an Academic Institution or Third Party Agency or Third Party Department to help leverage both the analysis and the data to make sure that we have something thats accurate and reflective of what i think the concerns that are raised from the individual cases that weve seen. Great. Thank you. And yeah, i think the well get to talk about this more later. But the d. O. J. Cops report specifically suggest using an outside organization. I think that would hopefully satisfy the chiefs concerns about staffing. And i am surprised to hear that access to data has been an impediment since by state law, all of our stop data is publicly available except for personal identifying information. So im hoping that any issue to data access can be resolved with dispatch. Okay. Seeing no other names in the queue, sergeant, could you take us to Public Comment for members of the public that would like to make Public Comment regarding line item six directors report, please approach the podium. There is no Public Comment. Line item seven Commission Reports discussion and possible action Commission Reports will be limited to a brief description of activities and announcements. Commission discussion will be limited to determining whether to counter any of the issues raised for future commission meeting. Commission president s report. Commissioners reports and commission announcements and schedule of items identified for consideration at a future commission meeting. Commissioner benedicto. Thank you. Vice president carter hubberstone. A couple of updates from me. Um lets see where to start. Earlier this week i spent some time with with the policy development unit, which has been sort of restructured to work within our written directives unit and the way the department is handling its policy development. I believe that the Vice President and commissioner walker have also attended similar meetings in the past. There are an Incredible Group of officers who are trying to who are spending a lot of time trying to get our policies in line. We heard from some members of the public today that theres a disheartening number of our policies that still date back to the 1990s. You know, i want to acknowledge the i talked to the chief about this before, about the progress. This commission has made. I think weve passed more general order updates in the last year than in the preceding significant number of years. So a lot of progress is being made, but a lot of progress still needs to be done. And so it was really educational to sit in with along with some of the Commission Staff and as well as assistant chief flaherty with in that meeting. Um, i also want to acknowledge i believe they left, but the members of the public who raised the issue of our public alert policy as one of the policies that the date back thats that dates back to the 90 ends. Ive asked them to send i believe it was the oakland policy that they both worked on to our Commission Staff so it can be posted for members of the public to see and hope to see that among all the policies that are hopefully updated, Going Forward as well as fellow commissioners know, weve continued to search for a our policy analyst position. Commissioner walker and Vice President carter and i will be conducting interviews for that shortly. And so hopefully that long saga of that vacancy will be coming to a close as well. Um, and i also lastly, i wanted to talk a little bit about the open letter that the Police Officer association actually sorry, before i do that, i also wanted to acknowledge captain obrien noted his Domestic Violence survivors month. Its also hispanic heritage month and Filipino American heritage month. So you know, a lot of celebrations in this month as well. But i wanted to close to briefly talk about the open letter that the Police Officer association sent to the Commission Office and shared with the media. I know lieutenant mcrae spoke about it in Public Comment. I dont see her her in the gallery anymore, but as she said, shes easy to find. So ill if given the opportunity, ill share these thoughts with her as well. I think it is important to note that every Single Member of this Commission Takes confidentiality incredibly seriously. It is. We are bound by charter by state law. Half of us are attorneys. We are bound by our own professional responsibilities and take and take confidentiality and our duties as the discipline body for our officers. Very seriously. And that is true of every single commissioner. We sometimes have disagreements up here on policy , on strategy, on tactics, but we do not have disagreements on our serious commitment to confidentiality of officers under our disciplinary proceedings. And it was disappointing that that this letter questioned that commitment, but also accused a commissioner specifically accused Vice President carter stone without any evidence s of violating what is, again, a very significant and serious duty. Theres agreement, i think, among this commission to get to the bottom of how confidential information made it into the public. And i think that there is agreement that we want to get to the bottom. And we heard commissioner walker talk about agendizing that and i think that is 100 appropriate. And called for. You heard the Vice President call for that to what i dont think is called for is to jump to a conclusion, to an accusation, a very serious accusation without any evidentiary basis. And that was that was disappointing to see. I understand that the poa has a responsibility to protect its officers. We as commissioners have a responsibility to protect officers confidentiality as well. And i think ive said this to a lot of people, its important that when we have disagreements on policy, we dont have disagreements on motive and we dont have disagreements that we have similar goals. And it was its been overall, i think, a productive year of working with the poa on a number of issues and it was disappointing waiting to see what an accusation. It didnt have any evidence when weve seen in the reporting that it was apparently weve seen from the publication that published the story that it was there was a document redaction issue and nothing at all tying it to the malice of any individual commissioner. And so i personally would like to stand up that i dont believe any of my fellow commissioners would violate a confidentiality of officers. I believe that every single one of my fellow commissioners takes that commitment seriously. And i defend my fellow commissioners individually. I defend our commission as a body. And i think that it was out of line to make that accusation without evidence. And i joined my commissioners commissioner walker and the Vice President and hoping that wed get to the bottom of how this confidential information was produced, but that we should stick to facts and not baseless accusations. Thank you. Thank you. Commissioner benedicto. And, you know, i echo all of those words, all of those sentiments. And i will be responding to the poas letter in due course. Just to updates for me. I like commissioner benedicto was invited to attend an orientation session with the policy development unit. I very much appreciate the invitation and a chance to meet some of the new employees and a chance to get a better understanding of how they view the policy making process and some of their thoughts and challenges. So i appreciated that and also like commissioner benedicto, i will be sitting on the Interview Panel interviewing applicants for the commissions policy analyst position and look forward to hiring someone and filling this this vacancy thats been open for quite some time. Commissioner yanez. Thank you. Vice president carter overstone a quick report from me. Had a good meeting with commander parra from the Community Engagement division, put them in contact with some folks that reached out to me about contributing and offering some Youth Development training for the department officers. And im and also contributing to Community Policing strategies. The connection was made and they will be moving forward trying to coordinate calendars. As i, i had a conversation with juvenile Probation Department president margaret brodkin, who invited me to go to the Youth Commission on sorry, to the juvenile Probation Commission to provide an update about our progress towards initiating the pre booking program and that update they requested in november. So it gives us a little bit of time to get a little more information in. Thanks, chief, for reaching out to the policy folks to get us the revised juvenile. Dgo 701 draft which which i know is a work in progress. And its good to be able to get my eyes on it so that we can provide some feedback and suggestions and lastly, i am working to coordinate with the Youth Commission in who has some questions around in the pre booking program that we are working on developing. And lastly, i do i did around this data conversation, i had a meeting with a professor from San Francisco State University who is interested in offering and leveraging some of their staffing to kind of comb through all these data points points. I know that it may be a challenge to engage a third party, but i think when somebodys leveraging their expertise, i think we should seriously take a look at that and see how it is that they can contribute. But considering what a large and heavy lift thats going to be, so i know that this is going to be agendized for us to figure out what the path moving forward will be. So im very interested in participating in that conversation and thats my report. Thank you. Commissioner walker, for thank you. So i will just reiterate again that we are in ongoing discussions about the recruitment of women into the department with the assistant chief lady over there for the issue of child care has has been raised. And we also ive been discussing this with at the state level with our senator and our the Governors Office to actually help with. I know that the state gave money to help with recruitment. And this is one of those issues of that could really help with these kind of Services Available for folks in our department. So i also discussed it with the sheriffs office, who who is also very supportive of having the service available. So im really excited about that. And also look forward to the update about the lactation stations and how we better improve those situations. And also, theres ongoing conversations about the patrol specials project. I talked again with our City Attorney and we are just the next meeting, i think is october 10th, where were going to start discussing very specifics about it, what it would take to do some pilot programs with our Community Benefit district partners, the specifics of that and not just the rules and regulations and training requirements, equipment, but also, you know, what we have to do to amend current agreements with the Community Benefit districts. Theres a lot of support from folks who are already doing private security, who really want to partner more. Ive also spoken to the folks in department of emergency manager that are running the heart program, which is the sort of the parallel of parallel infra structure creation to get folks is not aimed at jail or hospital oils into wherever theyre going. And it needs a whole other infrastructure to support the bringing all the parties together. So i really am looking forward to that discussion and seeing how that all works. The departments are already speaking together, but really having the kind of infrastructure we have that allows us to transport people who are arresting and who are in an emergency. It needs to be as effective. So hope really we can ill update and bring people in on that. I think thats it for me. Oh, i did want to mention that there is a october 20th, 26. There is a pink brunch at bill graham auditorium supporting Womens Health Breast Cancer supported by the sfpd, especially the womens caucus. Or is it the caucus of the womens group within the department . Im happy to share information and maybe ill give it to the to sergeant and he can let everybody know about it. But it would be great to have everybody there. Its a it should be well attended. I think theyre anticipating 14 to 1500 people. So okay, october 22nd, commissioner yee, thank you very much there. Vice president carter, also, i just want to report that last month, september 22nd, i was able to attend the safety meeting with cic and cadc. Thats a Community Youth center and the Chinese American Democratic Club that held a safety forum for in Richmond District with cap captain chris canty. Some of the concerns with the merchants was that on their there have been quite a few break ins, so i replied to them that they should also check their locks and making sure its properly the right type of locks for their for their door fronts and also hopefully they have cameras there to keep them safe. Cic was able to pass out some safety package information while i was there briefly to just introduce myself and to listen to their concerns. One of the merchants asked me is have you ever tried for filing a report online . I said, yes, i have. And he says his question is, is it difficulty . And i say, yes, it is difficulty. Go through it as as i experienced it myself. And the last one was, is there a translate options for other languages and i did not know that answer. So maybe ill talk to the chief after this meeting and get that information. If you have it. Thats all i have to report. Thank you, sergeant. Could we go to Public Comment, please . Members of the public would like to make Public Comment regarding line item seven Commission Reports. Please approach the podium. And there is no Public Comment on line item. Eight discussion and presentation on benchmark. First, sign a Case Management system at the request of the Commission Discussion on. There you go. You can just use. All right, thanks. Good afternoon, commissioners. My name is ron huberman, chief director. I am the ceo of benchmark analytics and we are grateful for the opportunity to be able to present to you. Today, im joined by my colleague nick montgomery, chief Research Officer at benchmark analytics. Hello, commissioners and chief. Great. So we thought it would make sense. Well give a quick overview and of course youll interrupt with any questions you may have or leave them, whatever the appropriate protocol would be. But i want to just start by thanking the chief and all the members of the San Francisco Police Departments who have been our partners in this endeavor and have been incredibly forthcoming and hard working and get us getting us to the current position that were in. So thank you for all that work. Great theres fundamentally three parts of this program, and today were going to be focusing on two parts. One is first sign, first sign is the brand name or the public name for the product that is an Early Warning and intervention system. And well be talking a lot about that product. What the data that goes into it and how we come up with the information that we do as well as system call care. So stands for case Action Response engine, and its what records the follow up actions after an officer has been identified for incremental support. So let me just start by saying a few quick things about benchmark. We were founded out of the university of chicago where the company was first formed. It was initially a research, initially a Research Project that that spanned over ten years that try to understand a fundamental question, which was can you use basic Police Operating data to understand and the likelihood that an officer is going to have a problematic incident rate and then use that data to try to get in front of it and help steer that officer and provide interventions and support to help get them on a better and different trajectory. The result of that research from the years of chicago is that the answering is overwhelmingly yes for police data does clearly show some officers need incremental support. It is identified, able and knowable, and theres a way to interact and do that. Our work is funded by the joyce foundation. Its a nonforprofit organization that is based out of chicago and works primarily in the great lakes region, as well as the American Institutes for research. The American Institute for research is one of the largest non Profit Research organizations in the country, and they do a lot of work with municipalities, counties and others. In this particular work. And so the three things that we fundamentally focus on as a company are how we get and how Police Departments manage all of their people. Data we do not touch the crime side of the house. We focus only on people data. So internal staff, data and information of what we do. We then use that information to help Police Departments understand which officers need incremental support and intervention, and then we help them track and manage those interventions. Ultimate to lead to Better Outcomes for those officers and the public that they serve. Just a few quick notes about us. We operate the Worlds Largest multijurisdictional database. Why thats important is its very hard for any one Police Agency to put together all of the information youd want to understand Police Performance globally. But because we do this across the country with agencies of all sizes, were able to take what we learn from any one agency and port those learnings from the data and analytics to other agencies that we work with and then the last thing ill quickly say is we operate late. We host, i should say, through the university of chicago, something called the National Police Early Intervention Outcome Research consortium. Its a mouthful, but ultimately its a place where Police Departments come together and can share best practices and understanding around what interventions work, what do you do, what are the best model policies around how to intervene, how to intervene, how to identify problematic conduct and the like. Just a quick other note here. Trying to look while i talk here. Were the only Research Based product on the market and so up until this point in really the history of Law Enforcement has been trigger based systems. If you get three of this over y window of time, as an example, they alert we have a Research Paper from our colleagues at the university of chicago that shows that those generally lead to a 70 false positive problem, meaning youre alerting a ton of officers that shouldnt be alerted. And typically a 40 false negative problem, meaning youre missing officers that you should be identifying. We came about this and said theres got to be a better way and a Research Based approach is what ultimately ended up mattering the most to do this. So what we can tell you is weve been very deep in this work with sfpd to date, and weve developed a model that is deployable and ready and pending, authorized version of a policy for its deployment. But ultimately, the data science results of it show that the model has 81 efficacy. See what it does that number mean . It means that 81 of the time when we identify by an officer within the system, within the next 12 months, theyll go on to have an investigation for a major event. It is about what we find in policing across the us. Our average efficacy rate is about 85. I believe its 81 today. Just because were not live, because the system gets smarter over a window of time. In the sf context, we used over 79 different data variables to come up with the Early Warning system. So there are 79 different variables that are involved. They fundamentally come from four different data sources. As officer attributes, arrest records, internal affairs data and use of force records. We find about 5. And this is a National Number of american policing. When we engage in Police Departments to be at risk. What we can tell you about american policing globally or nationally is its never evenly distributed. So dont think about 5 of an agency being at risk. Thats spread out evenly. Typically when we find risk, we find it in pockets so that any one community might be experiencing more risk than others might be, and that typically that 5 is creating 66 of the disproportionate force events. Im now going to pass it on to my colleague nick to talk a little bit about how the system works. And we can get into all the details as well. Thanks nick. Thanks, ron. So the way that the platform works is that it takes data fed daily from the sfpd data systems, brings all that information in and converts it into an assessment of those officers and their activity levels. Its looking at sworn officers who have at least one year of activity to begin that assessment process. And any officers included that has a one year or more as its looking at the data on a daily basis, it compares those officers behavior patterns over the course of their their tenure to other patterns that have existed inside sfpd historically. So its looking for those other officers who have been investigated in the past and looking at those patterns as to identify similar trends for individual officers. Those officers are identified and selected by the system. And then theres a secondary system that looks to compare officers to their peers. So not only is the platform identifying compared to prior patterns, but saying are the individual officers selected different from officers who are deployed in similar areas, similar ranks, similar times . Once it makes it through that secondary gate, the officers are released to a dashboard for prioritized intervention. Those officers are categorized into an actionable state and advisable state or a minimal state for supervisors to go through and begin the review process to determine next steps. So what does that actually look like . And what youll see here on the screen, as well as in your printouts, its providing detailed information on that officers risk history. So have they been alerted on before . Has it changed over time . Essentially is this a recurring pattern for the officer . Its looking at information for arrest patterns, complaints, investigation and discipline and use of force. And for each of those, its looking over the course of the past years to compare that officer and whether or not they have similar or greater levels of force investigations. Et cetera. Compared to their peers and the overall department, those individual areas that may be issues for the officer, theyre flagged as either elevated or high, telling the supervisor and the user that the officer is in the top 5 or top 1 overall for the for the department, and then they can follow down for detailed information about the specific events that the officers were involved in over their recent history. This part of the page is whats the main place for supervisor to interact and engage with to understand their individual officers who have been alerted on they get a broader view or they can see all of the officers that theyre working with and that is based on their permissions and their scope within the department. So sergeants would just see their unit. And as you move up in the chain of command, they would see other officers that are underneath their purview. All triaged for them into that actionable, advisable and then minimal state for them in terms of the officer risk with that, they can also track whether or not theyve begun their interventions, how long and click in to see additional courses of action and thats really where the meat is. That course of action process is where supervisors working with support from across sfpd, sfpd, can identify exactly what an individual officer needs and where their issues might have been and supports mentoring or coaching, coaching, training. Et cetera. To correct their behavior. That process is then reviewed and submitted to command staff for approval so that everyones aware of the officers and the supports that theyre receiving. So as we look at the system and the way that its being implemented, i want to echo rons statements earlier that weve had Strong Partnership from across the Police Department in terms of implementing, getting all the data in and building and developing policies. Weve got the data in there currently for arrests, complaints, use of force and assignment history, and that as Additional Information is added over time, it can be added to the algorithm to enhance the Selection Process as well. So that overall is what were seeing with the platform. And as ron had mentioned earlier, the system is ready to go. And right now and its waiting policy approval. And we know theres been i would just say as well, tremendous amount of work thats gone into that policy research and work to try to identify what makes the most sense for San Francisco. Really, really great work by the whole San Francisco team. Great thank you both so much for that illuminating presentation. Just a couple questions for me. Can you just at the very outset, you said we dont look at crime data , we only look at inhouse data. Can you just clarify what exactly you mean by that . Yeah so we look at officer behavior. We dont unlike a traditional case, a Case Management or a Record Manager system that captures crime data. Right . Our whole focus is a company and the work that we do is focused on officer attributes. So because of that, theres were not capturing crime. What we do capture is activity, though, right . Officer based activity. So arrest, use of force, vehicle pursuit, internal affairs, complaints that might be alleged against the officer. All of that data is brought in, but were not capturing otherwise criminal data inside the application in using that in the in the course of the evaluation right. Okay. That makes sense. Thank you. And then you mentioned the 81 efficacy rate. Does that include both false positive and false negative error . No what that statistic speaks to specifically is the likelihood that says from the moment someone is alerted. Right. So lets put it this way. If 100 officers were alerted, 81 within the next 12 months would have an investigation on for, i think, the definition we use here is a major adverse event. So would will there be some investigation thats launched . I i see. So i think maybe im not understanding this then. So you mean you tested it against Historical Data and youre saying if we you know, if we had known what we knew at the time, these officers would have been flagged before their event, basically . Thats correct. Okay. And then but then so i guess my flip side. So thats not capturing, i guess, false positive error. Right. But then do we have a sense for the number of officers who we wouldnt have caught, who nevertheless would have had a who then go on to be investigated . Right so weve the way that weve optimized the model and this is a decision made in in partnership with the department is to optimize for making sure that we get the when we do flag someone, that were flagging the correct person so that we gain buy in and trust with those officers. So were maximizing or minimizing false positives, right. And so thats were at that 5 is what were seeing in terms of officers across the department overall. Were not optimizing for the false negatives. And so do we have a sense like have we quantified the type two error for this model . We dont have the specific type two error on that, but thats something we can provide. And just out of curiosity, that seems like something one would want to know. Im just curious why that why that isnt something that was i mean, i understand why you might want to focus on one versus the other, but im just curious, like why the assessment of the models efficacy didnt involve assessment of type two error . Its included as part of our detailed review of whats actually happening inside the model. But our selection criteria for have we achieved sort of the goals, the model focus on the false positives. Great. Okay so you mentioned there were 79 variables and one question i just occurred to me is, will it be transparent to the person looking at the dashboard and why any particular officer was flagged . I mean, nowadays we read about ai, where the ai is doing a great job at whatever its supposed to do, but you just dont know what happened behind the curtain. And so with this number of variables, im just curious, will it be reasonably clear why you were flagged . Yeah if we could you know, weve got screenshots of the system that you can interact with right . Would it fundamentally allows the streets supervisor to do and its really designed for a supervisor right is to take a look at an officer for a window of time and understand what what is the nature of arrests that are occurring, what is the outcome of those arrests . Are they are they resulting in force now . Force the system doesnt treat force negatively, right . The system is measuring what we would call as proportionality of force. So relative to how much resistance the officer encountered, how much force was ultimately used to overcome that from a pattern perspective, we never look at one individual event right . Were looking at a pattern of conduct. And so ultimately what we are what the system is optimizing for and what its assessing for is to help supervisors understand what are the nature and types of arrests, right . What is the nature and type of force that that officer is using. What is the nature and type of allegations or investigations that might be occurring with that officer and then it localizes it for them. So, you know, we had the chance to listen to some of the dialog today. So, for example, an officer who is working in the tenderloin, compare them to an officer that might be working in a community that is very low crime would be an unfair comparison, right . Theres going to be fundamentally Different Levels or necessity of force utilization in. So it gives that supervisor the immediate Peer Group Comparison across all these domains so they can say, okay, if im a midnight sergeant in the tenderloin, how is this officer relative to other officers who are performing the same job function in the same neighborhood, interacting with the same same members of the public . And so what we typically see is its pretty obvious when you look at that dashboard and you look at these things to say, okay, this officer may have a problem with verbal engagement because its the nature and type of allegations they get. This officer might have challenges with de escalation. So the system provides enough data and descriptive descriptions to do that. We as a company dont include any analysis that cant be explained. So we are not a we are not an ai company where we just run, you know, random forest or any other, you know, Machine Learning algorithm and says, aha, someones at risk if we cant explain it in a way that and we use focus groups of supervisors from across the country that an that a supervisor cant look at it and say ah i think i get the problem. So then its were not using those measures. And thats a big part of why those peer comparisons are in there. And that secondary screening part is to make sure that its interpretable. All right. And on that, on that point of kind of normalizing or adjusting for other factors, what kind of work went into ensuring that kind of we understand which direction the causality is pointing into. So for example, you gave the example of normalizing for where which district station the officer is assigned to. But lets say, for example, in an officers assigned to a specific unit and that unit experiences kind of higher use of force, how do you know that that should be kind of controlled for because that unit is just put in more situations where they encounter those types of situations owns or its the opposite. Its that officers who are more likely to use force are disproportionately assigned to that unit. How does the model kind of understand whats causing what . So i mean, thats a great question, right . So theres as we think about the trade off between in the model itself, purely identifying officers who will be investigated in the next year versus selecting down to just those people who are different from their unit. So its a its a two part process intentionally for that. And its not it does not entirely rule out the possibility that if everyone is high in the unit, that its going to allow those officers to not be selected for. So thats definitely something we monitor for inside the system as part of our ongoing processing within the data. But there are certain patterns that even in a unit that so when we said that theres, you know, a small percentage of a police force that we identify, im going to speak nationally right . That may have problematic conduct that that 5 is never even there in a unit, right . Its a commissioner is what youre describing. But but even within problematic units patterns appear that we identify. So for example are you do you have a large amount of on view. Right. Discretionary arrests associated with the arrest, resisting arrest where theres injury. Okay that that pattern repeat id is almost always super problematic. And if you have a unit involved in that right that has a lot of that, then even though the unit might have a lot of utilization of force, its still going to be identified in our system and to be very clear about one thing, our system, we expend a lot of analytical time thinking about the fact that the system should never be alerting for high activity, right . So you can have an officer whos got a ton of arrests and a ton of other activity and never get flagged in our system. It is not a bad activity. Is the outcome of that activity that the system is measuring against. Right. Thats helpful. Last question for me. This is more of a straightforward question. As you described kind of this one year probationary period before you get provisionally kind of sorted. And part of that involves comparing your stats to historical stats. Are those historical stats just sfpd, or is that relying on your other jurisdictional databases . Its purely the sfpd patterns and trends. The National Database helps inform where the model starts, but everything about whats happening inside the model for sfpd is sfpd specific. Great. Thanks so much, commissioner benedicto. Thank you so much. Vice president carter overstone thank you for that presentation. I know its been rescheduled at least once. And so thank you for your flexibility on that. This seems like a program that has a lot of potential. I mean, weve been calling for a modernized Early Intervention system program. Ive been calling for that since long before i was on the commission, since it was in the d. O. J. Report, it was in the blue ribbon report. And so im glad to see that that were moving forward on that. I want i think my question is for chief, when they mentioned that all thats left is, is the policy implementation stage, do you mean that theres a general order that needs to go to the commission or like whats whats the what are the next steps in terms of implementation . So we so weve put out weve already put out the first phase of training. We put out some videos to socialize this with the department as we work through. And i wont say troubleshoot, but whatever issues come up in this, in this year, we will take that. And if we make it need to make adjustments to the training that weve already put out to anything that weve already put on paper. As far as the protocols that would be during that period. So not, not dgo, i think its not necessarily a lot of this is operationally setting the right protocols based on whatever we find during this year. And if i could just add to that, just with Vice President carter orbisons question, you know, theres always i mean, this is the obvious, but ill state it because it has not been said. Theres always a Human Element to the analysis. You know, these systems, as good as they are, only are effective when the reviewers understand what to do with the information. So like the unit you use. Question its a great question, by the way, but somebody has to dig deeper to determine whether these things that might be red flags are, in fact problematic issues. The system is can only alert. And so part of this is incumbent upon the department to make sure our folks are trained. They understand on what to look for, what questions to ask, where to dig. When these alerts come up. And that is vital to the success, in my opinion, of this working the way its supposed to. Thank you for that. And so as i understand it, then theres nothing that is needed on the Commission Level to enable the continued implementation of the benchmark system, not at this point. I mean, there may be changes afoot as we dig into again, what this what this offers. I think this is going to open up a lot more ability for us to do what is designed to do. So that might come with requests for the commission to weigh in on if it touches any of our policies as it stands right now is isnt governed by theres not a general order on is correct. No theres not a specific order on. Yes. Okay. So its not like they would need to amend any general order to enable this to continue to continue to move forward. Right. Thats correct. But ill double check that right now because i can look real quick. Okay. Yeah. And i know that i know commissioner yanez has has showed great leadership on this and pushing it forward. So i know theres great attention to the commission. So i know we wed love to be kept abreast as things update or if there are any, if there are any roadblocks that we can help plow through. I think theres the interest on this commission to do that. You know, ill note that you talked about kind of socializing this among the department. I think that is that is an important step. It reminds me a little bit of the what you saw in this department and others. You know, gosh, almost a decade ago when you saw the widespread implementation of Body Worn Cameras where there was at first a lot of skepticism. But what youve seen now is unanimously to an officer, every officer ive spoken to is a huge fan of the value add that Body Worn Cameras provide to their policing, the value that they provide to accountability ity to making sure that theyre able to do their job to the best of their ability. So i am hopeful that when we look at modern Early Intervention systems, as in the in the longer lens, a couple of years from now, it will look like what we saw with Body Worn Cameras, where after officers were socialized and understood the value that they become an independent, an indispensable tool for policing. So i hope to see that. Thank you. So, commissioner, i stand corrected. So 3. 19 is the icu at this point, i dont. It has not been touched in since 2007. So im sure there will be things that come up that might need to be revised. And this is probably i dont know where it is on the schedule, but its due for revision anyway. Okay we should keep that maybe at the top of the commissions and ill just mind, ill just chime in that there is actually like a parallel process taking place. And now with is also participating in that. We just didnt want to put a timeline because there had been some delays with implementation and with developing the actual platform so that is a work in progress. Thank you, commissioner martinez. And again, thank you for your tremendous leadership on this issue. Thank you. Commissioner benedicto and so i do have a couple of questions there had been a request at some point from dpa to see if the if the system was capable of sharing information in real time with dpa when it came to certain alerts and general failures investigations, is that taking place as. No, not to our knowledge, but its not a systems question. Its a policy question, correct. So im sorry , but i would say the way that our platform is designed is, is its not meant to be a gotcha system, right . Not that dpa is a gotcha system, but its not its not meant to be a disciplinary tool. Its meant to be a preventative tool by its design. So its all about incremental. So id say from a policy perspective, our position as a company and as a Research Organization is this particular tool is most effective at driving behavioral change. When its developed from the ground up as supportive, non punitive way to help those officers who are struggling out there. Got it. And the reason i ask the question not necessarily to criticize or try to contribute to changing your Program Model because it is a policy question, right. And for us, when we see such, you know, important technology, we finally reach our department. It is something that becomes useful across the board for our city to benefit from it. Chief, would you have any issues with sharing that information as far as there are certain thresholds that lead to an actionable risk as far as the languages here . Right or an actionable, advisable risk alert . And sometimes those initiate internal Affairs Investigations that that my understanding are some are not necessarily always as initiated with the knowledge of dpa or with dpa being involved for there to be a parallel investigation action, if in fact there was some type of, you know, dpa type of incident. But as far as there being you know, non compliance with a with a dgo or some type of behavior thats deemed, you know, in need of some type of action as far as disciplinary action is concerned. So if i understand your question, i that would be problematic if information if its a disciplinary complaint that dpa has and theres something an incident that also triggers an alert, dpa should have access to and will have access to the incident. But the information from the system is not meant to be used as disciplinary unless the investigation uncovers that theres discipline involved. So i dont know if i answered your question, but the answer is if there is something that triggers an alert that dpa is has the jurisdiction for, they would get that information. But the data from an alert being triggered just on the surface, i dont think that is that is what this system is, not what this system is designed to do. So the way i understand the system, once an alert is leading to what is the actual language here. A the action of alert. Lets see. Yeah, theres actionable alert and advisable alert and minimal risk. Minimal risk obviously doesnt issue anything actionable alert. Is the system saying that there is a strong pattern that needs review . And i think the chiefs point on the human has to look at it. Weve got police experience, actionable, advisable suggests, hey, the patterns going in the wrong way. And so someone needs to look at it, but it doesnt necessarily rise to the level of actionable. But the system itself isnt using any new information. So any investigative information, such as an allegation or other data thats feeding it is already in the system. Its already there. Right. Theres not. Its just using existing data or existing outcomes of investigations. For example. But its not it to help identify to say, hey, someone needs extra support or training or intervention. Right. But its not theres no investigation from our alert. Right . Its not theres no independent theres no independent investigation other than the identification of a pattern that says that officer may need some incremental support. And so when that alert reaches, the supervisor, i know that theres like a risk manager team that will send that alert to the supervisor, then thats up to that supervisor to determine whether that actionable alert will actually lead to a Performance Improvement plan or a disciplinary action. Correct. In this. So let me speak about this in general. Outside of the sf purview, because we dont speak policy for anyone. So ill talk about it nationally and just to give you a sense, we just came off last week. We had a National Summit talking about this very issue across the country. So and were very lucky that we serve everyone from very different jurisdictions dallas, charlotte , nashville, new york city, nypd, baltimore and the doj. D. O. J. Just brought us on for baltimores consent decree. So weve got a lot of experience in lots of jurisdictions around this particular work and there are two general models us that that have that have grown from the work. Okay . The original model is that it would get pushed down to the immediate chain of command. Lets say a sergeant and lieutenant in the immediate supervisors of the officer. Okay what weve generally learned about that model is it generally failed and it generally failed because when it would go to the unit, im talking about nationally, there would be little to no action. It would it would get dismissed first, right . Someone would look at it and say, oh, this is fine , and it would be very hard to get action to occur. The second model, which is a centralized Risk Management model, which is its only centrally managed, right . And we just had a major city that did that and then undid it. The challenge was, is that the folks who lived in the in the Risk Management bureau equivalent would say, hey, this officer on paper needs intervention. Right. But ive never ive never met nick, so how am i supposed to evaluate nick . Because ive never been on a call with him and ive never been with him. And so that model struggled. So the ideal model that we have and we have a model policy that we publish is a hybrid model, which it comes into a central risk bureau like organization, okay . They review it and then they partner with the local chain of command collectively to determine the right course of action and to help get that officer back on track. And its that marriage of the of the involvement of the immediate supervisors on the street. But with the central Risk Management together is what really makes it powerful and where we see the most behavioral change to the positive. I hope that answers your question, commissioner. It gives you some it answers how your system works, for sure. Yes. And the question is back to the chief. If at that point that supervisor iser determines this pattern of behavior merits some form of discipline or activates an internal affairs investigation, then can that trigger be shared so that in real time we have a parallel investigation, which is what is charter amended to do . Well i dont believe that is the case or should be the case. Dpa investigates complaints from members of the community. So lets say lets say the pattern is Excessive Force and officer has, you know, for Excessive Force. But theres no complaint from an individual. And the Excessive Forces are all deemed to be within the San Francisco Police Departments policy that that trigger would not out right yield necessarily. It would that would not yield discipline. But lets say one of those actually was out of policy. If i hear you correctly, youre saying that information should be shared to absent some dpa complaint is the question correct . Yeah, i dont think thats appropriate. Dpa do. Director henderson. Well, let me say, would there be a benefit if dpa has a relevant investigation, they will get the discipline history of the officer or if they have an investigation thats connected to this. But the idea of just i mean that thats not the idea that every time internal affairs sustains a complaint that that information gets flagged by dpa. I mean, thats basically what this would be. I dont see the relevance and i dont see where thats appropriate. If its a dpa investigation thats connected to this. And there is a there is a connection where that information is relevant to their investigation, absolutely. But just on the surface of every time a case that or a situation where a pattern of conduct is being investigated and lets say for whatever the circumstances are, it turns into a disciplinary situation. There needs to be some connection, in my opinion, to an actual dpa investigation. Director henderson. Okay. So two points. One on the information thats being collected and analyzed and disseminated can be helpful in terms of our practices separate from aghacha and separate from discipline, which are still relevant but is absolutely relevant to some of our policy conversations, legislative conversations and the mediation practices that we have. But the bigger issue and the ultimate issue that i think is the key here is rather than notification from the information being disseminated to us in real time , and this is what the conversations have been with benchmark. And i think with the department as well have been asking for a portal of access to the information for concur cases, not to create new jurisdiction, but where theres concurrent jurisdiction and open cases or from the dpas open investigations, if theyre shared information about concurrent cases that are going on from internal affairs and or from items or information thats been flagged from benchmark to have access to that information. And thats what we dont currently have access to. Thats what i believe were trying to work towards is does that make framed it so much better than i did . Well, it sounds like were saying either the same or similar things. I believe so. And ill just add a national perspective. We dont have a single we work with 200 agencies in seven statewide contracts. And i just give that for context. And every jurisdiction obviously needs to determine its own outcome. But we dont have a single one where this is disciplinary based or it leads to anything to do with discipline because it undermines the it undermines the buy in from officers and from supervisors who we need, who ultimately will make or break a system. Right. Theyre either going to take action or theyre not. And when we get them to take action, its because they they feel its safe to engage officers to say, hey, this is not right. I got to i got to help you be better at this difficult craft of policing or we need to support you in different ways that live outside of disciplinary track. Right . That is a that is a supportive angle. And so just for context, every other jurisdiction that has done this or weve studied it or weve worked with has ended up in that framework work for the ais program that we provide. Great. Thank you for that. And i guess in there is one of the questions that i have for our current it department chief. This system, um, i think relies on fidelity to a model that requires documenting discipline at and i feel, i know i sound like a broken record every time theres a report or a Quarterly Report provided where i see that there is one Performance Improvement plan for the whole department. But what are we going to do to, to shift the culture of our department to actually, when there is an advisable or actionable or, you know, risk recommendation or an alert for those supervisors to actually be put things in writing in a Performance Improvement plan that can then be revisited to ensure that what we are hoping for the prevention of an incident is actually taking place. Well, things are are put in writing and i just read one today, you know, Performance Improvement plan where it was everything was in writing, including whether that performance was was improving. So the things are put in writing. I think i believe what im hearing. Your question is, are we taking the appropriate action when we have something thats actionable, i believe is your question. So the Performance Improvement plan is one way to get at that. If, lets say, a an alert is triggered, the review is done like its supposed to, and the support is, hey, this officer needs to be on a Performance Improvement plan and theyre overdriving. They hadnt gotten in an accident. They hadnt killed anybody. But we know they were overdriving because of whatever the alert they are not talking to people the right way. And maybe thats the reason that theyre forced threshold is high. The force is may all be in policy, but the real reason is because the officers not talking to people the right way. And, you know, thats causing some of the issues. Those are things that that i have seen in Performance Improvement plans. Thats been documented. But the question i believe your question is how do we determine whether the performance is improving . Right well, yeah. So one one of one of the things is when you stop seeing, lets say that the example i gave with force, you see a reduction in the use of force. You you, you have a reason to review Body Worn Camera and see that the person is actually treating people with the dignity and respect that we expect him to. So there are measures out there and if those things arent happening and the force continues, then we have to go to another measure. It may be reassignment, it may be. And thats happened before. So there are there are there are things, concrete steps that have been taken with Performance Improvement plan. So i just want to say that because this will still be a part of at least the support that we can give officers when they trigger an alert. And if its a discipline case that triggers the alert, that discipline case will be investigated and whatever is appropriate, it will happen there as well. But the officer still may need support, even if the discipline case is investigated and sustained. And theres whatever the appropriate penalty, it doesnt mean that the officer that that that Performance Improvement plan goes away. Does the benchmark system or ongoing support provide guide development in those areas on how to, you know, create a successful Performance Improvement plan, how to, you know, gradually work towards improvement in certain areas . Yeah, theres built into the action plan itself which theres a screenshot there in the in the document. It helps the supervisors and the risk team first assess what the problem is , right . So what aspects of the data did you look at . And then it allows them to, it provides suggestions around mentoring, coaching, training, intervention, support so that they can select from as part of building that plan. Whats your follow up timeline going to be . How often are you going to check in with the officer . And then theres the capability for after, for after, after action plan follow up. So for example, some agencies will schedule 30 day journal entries where you have to report back on what youve been doing relative to the plan. So right. The plan itself helps the supervisors construct the way of doing that, to be supportive to the officers. Great thank you. Uh uh, director henderson, thank you. Ill be brief because i made my main point, but i just wanted to respond in part to what commissioner yanez was saying. One of the issues that i think you would expressed concern over was what those results will be if theyre not shared phd from d. P. A. And again, ive raised this issue before. I think if the statistical reporting and data were commenced, right . So its not just dpr even, for example, the things that i report on weekly, monthly, quarterly, annually, there is a commensurate report from internal affairs. You would see those things and be able to measure the efficiencies of bringing an agency like benchmark into the picture. And that was part of the original conversation justifying the budget to bring them here. And i think that thats a report that leverages having them actually speaks to some of the problems that we repeat frequently here about the lack of resources having benchmark at the table speaks to those lack of resources because the technology will be a tool if we use it effectively so that we have broader, more transparency and more efficiency in terms of what the data will be, because thats what we originally had spoken about was the benchmark was going to be and serves as more than a representation of just Early Intervention systems, but was also a tool to be used and now paid for. Thats both going to collect, analyze and disseminate information. So i just want to make sure that were still talking about the same things and not a narrow framework of just the reaction on to the actionable alerts. Theres a lot more information thats being shared to and through benchmark. And as long as we have the commitments to be expansive about it, that shared data and the collection of data, i, i think its a positive thing. So its and i know that you guys already have a benchmark or best practices because youre in other jurisdictions, both in terms of what what the capabilities are of benchmark and what you have done, not just with the departments, but with all oversight agencies and independent agencies, civilian oversight agencies as well. And youve worked with jurisdictions that have those agencies. His. Yes, in the past, yeah, absolutely. And theres a whole aggregate statistics piece to the platform as well, right . That theres i think theres two pieces to it. Obviously, theres individual alerts, right. Which is at the officer level. But then theres aggregate information that the system provides, which is pretty broad. And maybe what would be helpful when you guys are presenting in the future if theres a whole separate component, just to speak to the total of what the commission has jurisdiction on or over, if some of those presentation options speak to some of those shared Data Analysis or shared data capabilities with the civilian oversight agencies, that would probably be helpful and specific and then we wouldnt have this drill down to make sure that were not forgetting anything that weve built. And paid. For all right. Commissioner walker, thank you. Thank you for this presentation. I mean, i see this as an incredible personnel tool that is really going to take some time away from in human analysis and i think that i really understand and see the importance of there being a trust factor in what it is. Its really helping managers manage their staff and i mean, i think its important to see aggregate numbers of how many triggers there were in one given time around certain things and, and compare and see if this is working. And again, i want to im really reluctant about sharing specific data because it does then sort of cross over the line into personnel issues and feeling punitive. And, you know, it just its going to kind of defeat the purpose of having it. So i really understand that it and i really i love this because i think its really going to be helpful. So all right. Thank you both so much for the presentation. Thank you, commissioner yanez, for your leadership on this. Sergeant, could we go to Public Comment . Great thank you. Thank you. Members of the public that would like to make Public Comment regarding line item eight, the benchmark presentation, please approach the podium. There is no Public Comment line item nine discussion on Collaborative Reform Initiative quarterly update Second Quarter 2023. Discussion on. Here we go. Getting in here. I thought i was going into the white house. Did you did you. Good afternoon or good evening, commissioners. Vice president carter overstone chief director henderson. Im catherine mcguire, executive director of the Strategic Management bureau. We werent expecting to present tonight necessarily, but but we do have i mean, meaning our unit, but we do have Deborah Kirby here from Jensen Hughes, who is our our contracted consultant, that is doing the monitoring and providing monitoring on behalf of cal d. O. J, who is doing the oversight piece of our collaborative reform. So with that, ill hand it over to her. Good afternoon. As i pull up my powerpoint, my name is Deborah Kirby. I work for Jensen Hughes. So good evening. My name is Deborah Kirby. I work for Jensen Hughes. Ive been asked to provide a brief overview of where we are in the Collaborative Reform Initiative and then also to be available for any questions or concerns we may have at this time of the process next slide, please. So in. In 2016, the Us Department of justice came into San Francisco at the request of the then mayor and chief of police to look at issues within the within the city and within the Department Following some highly publicized officerinvolved shootings, the last of which was mario woods, our team conducted that initial investigation in and we came forward with a series of recommendations, 272in all that were focused on five strategic reform initiatives. As you just heard a presentation here that identified that there are concerns that are consistent across policing agencies in the United States and the concerns and the objectives that we identified here were consistent right . So use of force bias in policing, Community Oriented policing, how the organization holds itself to account as well as how it hires and retains personnel. All issues that ive heard discussed here tonight and i have heard throughout the years here in San Francisco. Next slide, please. So we published our final report under phase three in february of 2022. At that time, the department had accomplished almost 90 of the overall goals. The objectives of the recommendations at that time, our report in the final three identified what were some of the areas and some of the concerns Going Forward at that time, what had occurred was that the department negotiated through and with the California Department of justice to go into what we call phase three plus. And the goal of this program or this phase of collaborative reform was intended to help transition the department from a traditional monitor oversight role of some outside agency to one where they can self sustain and identify not only what are their organizational goals, but how do they want to go forward in the transformation. So consistent with that, what we wound up doing, if you go to the next slide, please, is that the focus here began in september of 2022. There are five project plans are aligned with each of the strategic recommendations with the exception of personnel, although that plays into one of the plans with the goal of coalescing the recommendations and the way that they were originally envisioned that they came in under strategic areas and they were necessary linked to help the organization build iterative practices that helped them to achieve the goal outcomes. And so under these five project plans, the department engaged and agreed with the California Department of justice. And two, on a timeline thats rather aggressive that ends in april of 2024. Our contract with this project extends to allow for final review and an assessment. Its no surprise here, but we know that there are always end of game or end of project issues and resolutions between the various stakeholders. And so that time expansion will allow us to deliver a consistent report that reflect all of the input of the stakeholders. Theres also a portion in this phase that allows for sustainable review. And so what that means is that of the recommendations that were awarded substantial compliance by the California Department of justice, we will dip sample and review to a percentage of those. Right now, its about 10 and waited in terms of their priority and their prominence in terms of the reform occurring here in San Francisco. So some of these were awarded early on the work on use of force was significant. The department was identified as having a leading policy in 2016. And since that time theres been additional work occurring. And so looking at that and saying, you know, is the organization capable of maintaining a level of transformation and accountability to what its promised to do . Further, what were looking at in next stage is that the independent monitoring review will assess not only the work done on the recommendations, but also the organizational structure as it can go forward in what we call to infinity and beyond. Right. Because as Police Issues are iterative, they they grow, they continue every day. And the question is, is there the organizational framework and capacity to address these issues in a way that is consistent, transparent, focused on Community Service and allows the department to demonstrate that it is following its policy and guidelines. Next, one. So when we talk about the project plans , there are basically two addressing use of force, right . And in 2016, this department had a significant issue with data, even though there are complaints about where the data is today, it has significantly advanced since that time. And what you just heard was a presentation by an organization thats coming in to help the department coalesce its disparate data systems into what ideally will be a managed management dashboard. And ill talk about that in a minute. But it what the use of force aspect of this is, is really to be able to start to measure, analyze and report consistently on the force that officers are using. Theres the sustainability aspect of that in terms of looking at whats going on around use of force and then also review of what the practices are and the policy practices of this organization. I need to note that the 2016, 2017, the department of chiefs substantial compliance based on its policy 5. 01. Since that time, its gone under subsequent review and revision of the departments own accord. And frankly, the disengagement policy that theyve recently published is probably a nationally innovative policy and one that we dont see happening in other jurisdictions. So thats a positive outcome, right. The other thing that weve noticed and we were just here last week on a site visit as part of the work under phase three plus was that youre seeing the training division, specifically the field tactics unit taking the recent officer involved shootings and looking at and breaking down whats happening relative to the video , the data, the evidence and identifying whether or not there are ways that training can help the department overcome a force situation or improve the outcomes of a force situation. So thats truly innovative and impressive work that the department continues to do around the use of force. Next slide please project plans three and four really are the ones i think have the most interest and part what were talking about under project three is advancing the Community Policing practices of the organization. And this thing called covid really put the end of phase three a little bit off of the rails. The department did a good job in terms of trying to maintain Community Outreach at a time when it was not necessarily feasible, but this phase is intended to allow the department to identify and define what its structures are for Community Engagement, to demonstrate that they have the capacity and the willingness to do so, and that they can take forward the early work of the stakeholders and collaborative reform and push that into a process that will allow them, the stakeholders and the department to Work Together prior project plan four is probably the more interesting one and definitely intriguing in terms of what the department is trying to do in terms of identifying bias and being able to assess and address whether or not there are bias practices and what does that look like in San Francisco . So you just heard the presentation of the vendor who will be working on that system and that is directly linked to some of the outcomes in terms of the recommendations. And so what were seeing within the department is that not only are they looking at this concept of bias, but as you heard here today, really looking to develop a management dashboard that will allow the department to identify, assess what officers are doing, but also make it transparent to officers in terms of their performance and what theyre doing, and then allow for the opportunity for managers, leaders to have Real Time Data to assess are there variations, are there issues, are there things that i should manage . Because the concept of management within Law Enforcement is not one that is widely inbred. And Law Enforcement is really focused on discipline because generally officers arise through a system of collective bargaining and they understand that. So the ability to have this data and move it forward, i think really will put the department on a National Best practice standard and then finally, the fifth project plan, which isnt addressed here, is really about the department looking at its internal internal affairs data and how again, how they look at discipline and what does discipline mean within the department and frankly, whether or not theres disparity in discipline practices. And so these five project plans together, you can go to the next slide. I really want is going to bring the department. I think, into a wrap up of what collaborative reform is about. But also allow the department to demonstrate what its commitment is to the community forward. Now that being said, you know, there are challenges and issues for every plan, right . So ive discussed the promising right that a management dashboard. But the one issue that i think is imperative to understand is that in 2016, when we came here, the department was really in a reactionary mode and wasnt necessarily inclined to look at practices, things that were identified as not being appropriate. What you see in this Department Today is one that is learning, focused and really at iterative improvement. And so you have commanders now, you have deputy chiefs, you have chiefs who were leads on the development of the project and the recommendations in the early days. And so that allows the department to operationalize it, challenges. All right. So resourcing so were hearing discussions today about whos addressing narcotics and whos doing this. And some times the actions of data collection, analysis, getting reports, dip sampling and audits are not seen with the same fervor that having police on the street are. And so in a self driven reform program, which is what San Francisco has and is unique nationally to any agency that im aware of, resourcing continues to be a challenge because theres not a judge, theres not some lawsuit thats forcing behaviors. It completion timelines on it projects are always notorious for delays, but also that can the it plan deliver what is anticipated and is expected by the department . And the timeline is a challenge. We have until april of 2024 for a completion and there are pressures that will come up against that, part of which are resourcing and it but it will also continue to go. And then we continue to hear some discussions around policy development. It was an issue in the original report that were not deep enough in the woods right now, but the revisions of 3. 01, the policies that weve seen promulgated have shown that the department is able to work within the system, but just to make sure that there arent any backslides in terms of any of the policy applications, as we havent seen it yet, but that will be part of this process. Next slide, please. Back one. Thank you. So the one thing i do want to say and ive said it is that San Francisco is a unique department in that it voluntarily, although somewhat less so. Right. Undertook a reform approach which when the us, doj exited this situation in 2017, the department in the city could have stepped away right . But they elected to continue to move forward with the reform initiatives. And so that is something to be commended. Youve had California Department of justice as the oversight partner for a period of time and youve also got organizational investment in this program. Ive talked to people recently, like i said last week, we work with the teams, we work the project plans, the goal and the focus of how to improve is present invisible. And so this is not going to be easy. Theres 1300 officers out there. Each one can make a decision at any time. And were answering questions and issues regarding that officer. But if that structure is there, if that Stakeholder Engagement and the transparency remains as this department is well positioned to be successful in the future and so for me, thats a positive end to this presentation and frankly, to several years worth of work. So im here now to answer any questions you may have. Thank you, miss kirby, for the presentation and director mcguire for being on hand. And a couple questions for me. Weve recently discussed we discussed a little bit today, but at the last meeting we fully agendized the issue of the departments auditing of its stop data. And we discovered that in essence, the department isnt auditing its stop data, not not any audit that would catch anything that would call into question the integrity of the data auditing of stop data is something that the cops report comes out and says its very important. Its specifically recommends engaging. A third party like a university. And i think the words that you use are that kind of like the bare minimum is to get an independent outside partner that thats considered best practice. Were obviously not doing that. Were where do you see where we are now on auditing of stop data and do you have a. Jensen you have a view on what steps we can be taking to the commission is going to be actively considering this. So i just curious if Jensen Hughes has a view on kind of what direction we might consider going in . Yeah. So theres good and bad news here, right . The submission of data, the stop data for how many years hasnt been basically audited by most agencies who are engaged in it. Shocking to me. I come from a state where that was audited. So i think it is a problem throughout california. I also believe that with the work thats being done currently in terms of the management dashboard, the ability to link the various databases will help inform. But our original call investigation review assessment identified that there were significant issues and i dont know that theres been strength placed in developing those those standards. Now, theres challenges here, too, right . So what type of organization comes in and how do they do that . And frankly, whether or not the department is in a position to be able to continue and maintain a level of audit. Weve talked to stakeholders to this process is short answer. It continues to be a challenge. Its not one that i see a nearterm solution to, but it is one that is part of the closeout of this project. Weve been having conversations. There have been some outside Agency Brought in to look at various aspects of the data, as youre aware, but as it relates specifically to stop data, i think that continues to be a challenge for the department and one that well be working with them. Great. Thank you for that. I think it was last week or maybe it was last meeting or maybe a couple meetings ago. I asked the chief if he would be amenable to putting on our website all bureau orders, bulletins, maybe some Department Notices, but but putting up all significant policies that are not department general order, general orders. Im looking at my notes. I think at page 149 of the d. O. J. Report that was called out as kind of, again, something that was basic best practices, the chiefs response was that i wasnt prepared to commit to doing that and cited staffing issues. Im just curious if you know, Jensen Hughes has a view about the necessity for transparency around all all policies that govern how officers in the field carry out their duties right . So i think the issue that we saw first on was that Department Notices were being used to circumvent the due process. Right . And so thats why it was called out initially because it was unique and frankly, probably counter mounted. The goal of the process established in the dgos when we get down to bureau orders, unit orders. So when you look at a large Law Enforcement organization, there are multiple orders and the ability to keep those aligned and consistent with the change in policy that you were just speaking about, a policy that hasnt been revised since 1999, i came from the chicago Police Department. Id go into units where i was commanding. Id be like, when was the last time somebody touched this book . So i think theres two things here, right, is that the department has committed to transparency around its dgos thats consistent, right . But but to be able to build a process internally where theyre able to maintain those standards becomes part of, i think, you know, transformation and beyond. Is that what are those auditing . And when i say audit, i mean Something Different here because of los angeles. So ill use pauls term of review. What are the review practices around the update of unit policy is and i think theres several things that you have to focus on initially because it is iterative. What are your risk issues . Right . You know, are you do you have different use of force policies . Id be looking at swat right. And what are your positions around stop what data are you maintaining thats pii and is there anything thats not consistent with the current organizational rubric . So the long term answer here is, is that i dont know that it would be helpful to put every unit Order Division order up on the site. But i do think that the organization itself needs to be able to establish a rubric under which those policies are reviewed, are consistent with the practices and where they Impact Community concern. There should be transparency to them. Great. Thank you. Yeah. You spoke primarily to two policy revision, and i do want to ask you about that as well. But just to this issue of transparency, is there is there any reason why we shouldnt, for example, post publicly every bureau order, or is that not what what the cops report directs us to do as well as a recommends that we do as a best practice . Yeah and i cant answer what is contained in the unit orders now because. No, no, im sorry. Just bureau orders. Bureau orders. Yeah i dont even know whats in the bureau orders, but to my understanding , there shouldnt be anything thats inconsistent on, you know, theres always a concern about whether it directs a specific tactical action. But i dont think that would exist at the bureau level. But i cant speak to that. But conceivably, there should be transparency to the orders. Great. Thank you. On this larger policy issue that that you raised, it does Jensen Hughes have a view on kind of what best practice is are in terms of policy making . I think, you know, weve talked about this commission, the need to revisit 3. 01, which sets out our policy revision practices. And i think many stakeholders perhaps for different reasons, also agree that revision of 3. 01 would be appropriate for my perspective. Weve had recently the issue that youve flagged the department using bureau orders improperly to circumvent the geo making process. We just they just issued two bureau orders that clearly should have been dgos. In one case, it directly conflicted with an existing dgo and in the other case a geo revision was well under way and the department front ran that and just issued its own bureau order. Weve had deputy chiefs blow owing deadlines under 3. 01 and not even taking the time to request for an extension of time. So we just lose track of policies and where they are in the process and weve had some new very innovative interpretations of 3. 01 from the departments policy unit claiming, for example, that that that geo affords them unlimited time. Now to revise a geo despite setting out strict time limits. So thats those are some of the issues from my perspective. Certainly the bureau order issue is spoken to directly many, many times in the cops report. Im just wondering, in jensens hughes practices or experience whether you have recommendations about how to make our policy revision process work better for. Yes. So youre raising issues that im hearing anecdotally. And so we really havent had a chance to look at what is the current status of whats going around the policy review. I think that theres a couple of things in play here, right . Is that policies are meant to guide the actions of Police Officers and sometimes those requirements require some sort of Swift Intervention or, you know, if somethings deemed illegal, if something occurs that the department knows that it needs to switch it has to have the flexibility to do that. However, when it comes to those community facing concerns, what is the measure thats in place to hold the department to account to ensure that there is then a public view, approval and implement of those policy requirements . And so that truly San Francisco is a Good Practice in a lot of ways in terms of its community involvement. I mean, that is something that is, you know, continuing to be progressed across the country right now. But you also face a challenge in california thats a little bit unique. Is that most agencies are lexipol, right . And so this concept of policy and how to build policy and how to actually manage policy remains a challenge for a lot of these agencies coming out of lexipol practices and in San Francisco, you know, it is a major city, right . And so the size of the bureau and what are the specific needs of the bureau . How do those drive those policies . So its this concept of community facing issues. And then, frankly , how do you get operationally what you need to get done and where do those two intersect . And in some regard, this idea of time, you know, it goes to both ways and how does that get done . And so to me, 3. 01 was developed by this group with a goal of improving policy development. But it has some tweaking, it seems, because we hear comments from various stakeholder ears regarding that. So its best practice were working on that. I cant tell you that theres one solution. San francisco is unique and were trying to work for that solution. And one other thing on this on this issue of policy making, one thing about 3. 01 is it gives a lot. You know, Department Leadership get a lot of input throughout the process. But theres no built in requirement that the commission consult and solicit actively the thoughts and feedback of line level officers who will actually be charged with implementing the policy. Do you see other jurisdictions as engaging in involving officers more soliciting feedback and when revising policy . It depends upon the policy right. So and it also depends upon the agency. So theres a lot of policies where they have the smees, which are the officers actually doing the work in some circumstances that review and inform the policy. And thats a practice like a policy working group that has various levels of officers working on a policy. Theres also ways that, you know, i have agencies that are using the system similar to the department and how they send out orders that they send out notice to officers to make comment, and that those comments then are received and evaluated by the policy unit. And so theres ways to expand the visibility and the input of officers to the policy process. And other agencies are doing that. Great. Last question for me. You you aptly described a period of time that you referred to as infinity and beyond. And im just wondering what what does that look like concretely . Once Jensen Hughes moves on to its other, more important work in cal d. O. J. That that mou expires who is or maybe its just the folks up here but but what do you envision as the process for ensuring that we maintain compliance with what weve already reached that we are meeting compliance for the outstanding recommendations and that we dont backslide on recommendations that we that we have completed . Yeah. So theres one thing that i just really want to put out here right now is that this is a significantly Different Department and frankly process than what we saw in 2016. And so its been iterative and sometimes when youre sitting in the chairs, you dont see that. But coming back from where we were in 2016 to where we are today, i think that theres a lot of good here in this organization. The city and in its stakeholders that should be recognized. I think that, you know, and beyond really addresses the issue that youre raising. Can these stakeholders work collaboratively to address the real issues and concerns . Because you may disagree, but you all believe in the process. You believe in this department, you believe in this city. And so each of you need to work in that. I am by no means pollyanna, but i do believe that the ability to create an operational framework that looks at one, you know, whats going on with the stakeholders, what do we need to do . And three, how do we improve . It is key to ongoing success. Theres always going to be some issue thats the nature of policing. Its the nature, nature of where we are in terms of crime, right . But the ability to apply the principles of for the community by the community and are we doing the thing that we want to do under our own goals, i think are critical to continued success. And thats why its important to recognize that this is more or less self driven. This this city, this department asked for this. And this is where it is. And so when i say when dads out of the room, how this city and how this department goes forward, i think the framework is here now. And its important because a lot of officers, a lot of lower level supervisors have been exposed to this program. They have grown up in, you know, in the department owning it. And theyre now at places to make this continue to go on. Now, theres always going to be challenges, but its how you address it. And i think that that framework has been instilled in this organization and now were working on it under three plus to make sure that its fully there. But theres hope there. Great. Thank you for that. Commission benedicto thank you, mr. Vice president. And thank you, miss kirby, for that presentation. And for the continued commitment out of Johnson Hughes to this work. I wanted to ask most of my questions are focused around the sustainability review for already completed recommendations. The dip sample would this process allow as part of that review . If there were if there were backslide observed, would that include Johnson Hughes changing the designation from substantially incompletion to Something Else . Or would it would it just like what would that look like if you if in one of the recommendations you saw some backsliding the ag has final authority on saying whether or not this department has been seen in substantial compliance. And so the award was at a point in time. Right. And so now the goal is to say is the is the department maintaining those goals that were identified and awarded at that time. If theyre not, therell be a conversation between the department, the cal d. O. J. And frankly, a framework of discussion as to what that looks like, whether or not it might be a mediation plan or some aspect of that regard, and dont necessarily walk back the initial award, but we can identify what that framework is now and where the department may be deficient and then identify what would be the expected outcomes as a result of that. That makes sense. So since the award is a snapshot in time, it wouldnt change that award, but the ag could not note that a snapshot in time now would no longer find that in substantial compliance. Right. What youre saying . Right. So if, for example, you like take use of force, it would be a totally unlike the hypothetical. But if this Commission Suddenly decided we wanted to unanimously revert to the 1995 version and, you know, obviously the award was because that version was was superseded that the doj would be able to note that that in in the report that comes at the end of phase three plus. Yeah and it also and you just raised an issue there too is if there was a significant deviation from what was deemed as a successful outcome. You know, if you look at the overarching five areas, if the department completely walked away from its use of force goals, i would anticipate that there would be more than a discussion around mediation. I would as well. Okay, wonderful. I have so the dip sample will be about 10 of the recommendations. So thats about. Is that right . You said, yeah, were looking at about 35, right now. Thats about what well be looking at. Have the 35 specific recommendations thatll be part of the dip sample been identified by Jensen Hughes, or is that still not at this time . We last week. Thats why we were here. Were looking at some weighting, obviously certain areas will be of more interest than others in terms of so. So youve got a couple, youve got some distinct issues here. You have several that were done very early on. All the work around use of force. And then you had a, you know, several recommendations that came in at the end of phase three. So therell be a little bit of examination on that. And then the rest of it will be distributed through the other strategic areas. So is it the case then that it will be weighted based on that and then randomly selected within that or. Yes. So its not the case that theyll be sort of hand selected . No, no, no, no, no. Therell be yeah, therell be some weighting and then random selection. A couple might be hand selected based on their prominence or what were seeing emerge. But for the most part it really is weighted to what, you know, what the issue is and how its perceived in terms of its overall compliance. And for example, a lot of the work on bias is being done now. So we wouldnt weight that as heavily because theres current work happening that will inform the outcome. Understood is it the case and not being like, would it be possible know we talk a lot about a lot of the recommendations here. If you know between the commission, between and the department, if there were a discrete number that we would want hand selected in the dip sample, would that be something that Jensen Hughes would be in a position to accommodate concerns about specific recommendations . I would ask that youd forward them to me, i mean, were were looking we may we may have already selected those. And so we could we could adjust that. But clearly, if there are concerns that are being identified and by all means forward them. Okay. I wonder i wonder if thatd be something that we could discuss as a commission along with the chief and director. Henderson because i think that and just one clear thing i have to approve any plan with d. O. J. But it is helpful to recognize if theres areas in particular. And so as were selecting recommendations to review, it would be helpful. I mean, i think one example just off the top of my head is i know weve had extensive discussion about the about the stop data audit recommendation in this commission. And so but i think it might be helpful to help to provide that input for cal d. O. J. Consideration. And on that issue, i mean, it is a problem across california. Of course, a lot of agencies were delivering data without really having that firsthand knowledge of what was being delivered. So its something thats being worked out and there may be Solutions Forthcoming from other jurisdictions as well. Perfect. Thank you so much. And i do want to acknowledge something that you had said. And, you know, for members of the public that are watching that are less well versed on the broad picture here, you know, you had this this 2016 report that was its been its been nothing but years of upheaval with the department of justice pulling out with covid, delaying a lot of the Community Input stages. But you have had i know even your entity has changed names but have had Jensen Hughes consistently working throughout this process. And to have sfpd in the Strategic Management bureau, working consistently on that process, it is a lot of incremental changes that have added up to a lot. And i dont want to understate that when we talk about the progress that we all agree still needs to be made. So thank you, miss kirby, and thank you, director mcguire. Commissioner walker, this is really been helpful. So thank you for being here with the report. Um, certainly theres always something institutions can do to get better, but it does feel to me in this report that we have a we should be proud of what were doing with with all of our partners out in the community. Um, i, i think that, i mean, i know its hard to compare, but it does feel to me like a lot of the models that were engaged in are our models across the country. So i just want to thank the chief, thank all of our command staff for engaging in this and the commissions pressure, which happens a lot. Um, its you know, it really i think our city should be proud of our Police Department and a lot of it is because were engaged in this partnership. So thank you very much. Early on, we identified that the San Francisco Police Officers were all well informed. Many are highly educated and really had a good natural way with the community. And so we continue to see that even today when i was trying to get in here. So that was helpful. Great thank you again. Thanks so much, miss kirby. Appreciate you staying late with us. Thank you. Oh, oh, we had a last minute addition. Im sorry. Yeah thank you very much there. Vice president carter. So, again, i want to thank you also for all the hard work were putting this through. So i know this has been a long process and thank the chief, the commission and all the members that went through it with us. My question is, the time how much time was, you know , for a staff of 1500 or how many officers we had . What was the time spent on the training for these or to bring to bring the members up to i guess, to the policies and to meet d. O. J. Requests and then the second one behind it, i guess its an annual or continual process. And what it is that in man hours in a yearly base this my thoughts. Yeah so what i can tell you is that our job was in the weeds, so to speak, part of the success of this program is that the chief did develop a standalone bureau that helped guide and direct that right. And so when youre talking about training, i would argue that it continues, its ongoing and its been significant, right . Every time theres a switch in use of force to meet legal requirements or to meet policy goals, that invokes training the department is also mandated to deliver training through the post out training, as they call it. And so the i guess the good thing for this department is that its been committed to training. One of the success outcomes. I think, in terms of use of force is this recognition of the connectivity to persons and Mental Health crisis and so early on, the department invested in training officers on that coming out. Also trained all of its supervisors. And so you had an informed response when youre dealing with somebody in Mental Health crisis. But that also included changing and dispatch codes. So this, you know, for lack of a better term, wraparound view of what an issue is and what can be done to help improve that has been, i think, a significant investment by the department in terms of training , i would argue that youre seeing the value of that investment and the decreased use of force and frankly decrease the severity of use of force. Okay i guess what im looking at is, is that additional resource that is needed in the Police Department that adds to the like the command staff to have overlooked the policies and the changes . Well, i youre asking my opinion, so ill give you my opinion. I think its critical. So the challenge that we see with Law Enforcement is that there was a disinvestment nationally in training. And frankly, here with like, you know, canned policies that organizations fell away from identifying goals and how they wanted officers to behave. And so what youre seeing nationally as a result of certain issues arising out of the george floyd and Breonna Taylor is a reinvestment in what we want our officers to do. And that includes policy. It includes training. It includes field supervision. But its not organic. There has to be an engine that drives that. And so to be able to do reviews, audits , dip samples, make sure that people are doing what they say theyre going to do, sometimes is at that field level. And you heard benchmark talk about that is that units are focused on what theyre dealing with on a day to day. The structure that allows people to visualize, look across the organization and say, does this need some help . Is it still spinning, has to rest with somebody for success in terms of what we want in our police and what our communities ask of police and thats true here in San Francisco. Thank you very much, commissioner benedict. I thank you for recognizing me. Mr. President. I did have one more question about the dip sample, which is i know when these are done in other contexts, depending on what you find, it could potentially be expanded, right . If you see irregularities in, you know, when you do these sort of dip samples, is that something that is provisioned for in the way Johnson Hughes envisions this . Again, im hopeful that it wouldnt be. But if you were to do a dip sample and you said, oh, of these 3517, we felt like there were deviations. We have this mediation plan. Would that merit an expansion or an additional inquiry . So at this point, the department, through the bureau of strategic services, is, as i just butchered that right, is currently overseeing the implement portion of the recommendations that have always already been substantially compliant. And so theyve got a process by which theyre measuring the adherence to the requirements. And so its our anticipation that were not going to see significant gaps. And what the department is doing, you know, might there be something where were saying, okay, this is not trailing . Might it be, you know, theres possibilities everywhere, right . Because there are 272 recommendations. But i dont anticipate a significant gap. The process itself doesnt address if there is a significant backslide and what would occur. But i can anticipate that there will be consequence to any serious backslide. But i honestly at this point, we dont anticipate that the recommend actions were necessary interconnected. There were a number of them, but they were iterative and task based. And so based on what were seeing in terms of the ongoing compliance review, we anticipate not to see significant issues. But if something unexpected occurred, the ag would potentially we would anticipate a significant response. Yes. Okay thats all. Thank you very much for recognizing me again. Um, all right. Seeing no names in the queue. Thank you again. Uh, and sergeant, could we go to Public Comment . Thank you. Members of the public. Theyd like to make Public Comment regarding line item nine cry initiative. Please approach the podium. And there is no Public Comment. Line item ten presentation and discussion of the disciplinary review board findings and recommendations. First quarter 2023 discussion. Well go you. Good evening, commissioner. Chief scott. Director henderson, members of the public. We are here to present on the recommendations and discussions that were had at the disciplinary review board. Id as a way of background, this is a board that meets quarterly to address aggregate trends and sustained cases of policy failures and training failures to try to more nimbly address any issues in real time as theyre coming up. So all right. So aggregate trends identified by iad in q one of 2023. So so, so my apologies to the commission. I was presented with the quarter two for 2023. So thats what i was prepared for. And then he said quarter one. So im going to slide right into this. So for quarter one, we had conduct unbecoming an officer or member neglect of duty, specifically Body Worn Camera and improper search. Dps trends for the same time frame also included neglect of duty, specifically Body Worn Camera violations in proper search or seizure, inappropriate comments or behavior and failure to properly investigate. One of the things i want to highlight, and i believe we talked about it the last time we presented, is there is also an ongoing discussion about what what actually a trend means. And i like to remind this group when we talk from disciplinary review board, its not statistically significant. Its more of identifying trends as theyre happening. So we might say that the trend is search or seizure. That doesnt mean weve had an overwhelming number of search and seizure cases. Its just that at that moment in time, those are the most prominent cases on our caseload. And if i can just add specifically, were looking at information that supports a timely identification of any issues that would warrant updated guidance that would give us change effectiveness or a corrective action at the same time. So thats thats the core of it. Not so many how many, but what does that lead us to in the information in an. And so from there, well go into policy failure findings identified by iad. Okay so iad had three cases closed in First Quarter as a result of policy failure. One case has been presented to the third to the third quarter, 2022 drb meeting and is regarding an incident report not being assigned to the appropriate investigation unit. The second case was presented in the Fourth Quarter to drb meeting and regarding a case where an a psa was unclear if they were able to take a specific type of incident report at a district station, both cases resulted in a recommendation to update the Relevant Department policy. The third case was regarding an ois. The case led to several policy recommendations and changes, including updates to dgo 5. 018. 02 and the creation of the f. T. F. O unit and the vr training course. Dpr had two policy failure findings. The first involved plainclothes officers not wearing Body Worn Camera at an incident as at the time that it happened, they were exempt from wearing Body Worn Cameras. The policy regarding plainclothes officers wearing Body Worn Cameras is currently being updated to address this issue. So its nice when we kind of see that the cases were seeing align with the policies that were developing. So thats an example of why drb is working to do what it set out to do. And the second case where we found a policy failure involved an incident where a person in custody was held at the district station for an extended period of time due to the county jail not accepting custody. This is something that we have seen. The departments aware of it. We get a lot of complaints about it. And so its really beyond sfpds control. Its really a sheriffs issue. But i know everybody is working on that, and that is something that we continue to discuss at these meetings. So we have training failures identified by both dpr and excuse me and iad in quarter one of 2023. There were no iad cases in the First Quarter that resulted in training failure findings. Dpr had one case that resulted in a training failure, as well as a policy failure finding officers froze a location pending the issuance of a search warrant but still entered the location. Dpr found the departments training does not provide adequate guidance as to what freezing a location allows for as well as what constitutes exigent circumstances to allow a warrantless search of a location. And again, that speaks to training. Thats pretty specific, right . So theres general Fourth Amendment training thats happening. And because the law has changed so quickly, we there are very specific instances where officers need more guidance. And so this is an example of us having those conversations more quickly than what would happen before, where we would finish our whole investigation and then issue the finding wrong as opposed to being able to talk about it more nimbly. Okay so out of this particular drb, there was one recommendation and i am happy to report on what that was. That the Department Needs to update training regarding Fourth Amendment specifically around this issue of what actions can or cant be taken when freezing a location to get a warrant. The updated training should also include more guidance on what defines exigent circumstances and what allows officers to make warrantless entry into a premise while they are trying to get the warrant. That concludes our presentation on. Unless you want to hear a chord or two, im ready for that. One great. Thank you both for the presentation. I, for the first time tonight, i think i see no names in the queue. Youre welcome. Oh and i was about to throw my pencil at it. Right. Okay. Thank you very much. Okay. Thank you so much, sergeant. Members of the public that would like to make Public Comment regarding line item ten, a presentation, please approach the podium. And seeing no Public Comment line item 11 discussion and possible action to adopt revised department general order 3. 05 department weapon return Panel Discussion and possible action. So we have so we have our subject Matter Expert here for that one. And let me grab my presentation. Sorry. 1994 was the last revision of this. One i have. Yeah. Okay. So commissioner, im going to just be very brief on this. There there werent a whole lot of changes on this particular policy. There were some some tweaks to basically update the policy to our current structure for in terms of the members that sit on the panel. When you look through the red line version, which is attached to your agenda, most of the changes is were wordings and. Not a whole lot of substantive changes. So if you have any questions, please, i can answer them. I was involved in this conversation even though we dont have our deputy chief here, but i can answer any questions that you have, chief. I see no names in the queue. And i just want to say the way you jumped into action, there was truly, truly laudable. And remarkable. Thank you for the presentation. Um, i. I will. I will make a motion to adopt the. Dgo second from members of the public who would like to make Public Comment regarding line item 1103. 05. Please approach the podium. And there is no Public Comment on the motion. Commissioner walker, how do you vote . Yeah, commissioner walker is yes. Commissioner benedicto. Yes. Mr. Benedicto is. Yes. Commissioner yanez. Yes. Commissioner yanez is yes. Commissioner yee yes. Commissioner yee is yes. And Vice President carter overstone yes. Vice president carter overstone is yes. You have five yeses. Line item 12 discussion and possible action to approve revised department general order 8. 04 Critical Incidents Response Team for the department to use in meeting and conferring with the affected bargaining units as required by law. Discussion and possible action. Thank you, commissioner. We do have sergeant art howard here, who is our subject Matter Expert on this one. Again, its a fairly short two page ego and ill just open it up for questions. I mean, i think a lot of the work on the Critical Incident Response Team on behalf of behavioral science unit is really laudable work. Again, not a whole lot of substance substantive changes, but we do think this policy is adequate in in line with what this department is trying to do with our Critical Incident Response Team. So if you have any questions, i or Sergeant Howard or both of us can answer. Director henderson. All right. So i dont want to take away from any of the substantive work that was here, and im excited. This is im happy this is moving forward, this was identified, though, as a joint response. And that theres some stuff going on back and forth as to whether or not what qualifies as joint. I dont want to go into the weeds with all of that. But i do want to say that this is an ongoing issue in terms of working back and forth with the department that both myself and my staff is working with the department on. Ive had conversations with the chief. I know my chief of staff has had conversations with the assistant chief back there because were really were both concerned about preserving our resources in terms of how we move forward and maintaining this process to make sure that its something thats efficient and timely and im flagging it now. How about dpa being in the role of maintaining challenging , preserving deadlines and accountability within the process that is, i think is moving towards a new a different , more collaborative process than what weve been fighting back and forth with. So i just wanted to flag those again. Ive already had conversations with the chief and were in conversation about what some of those changes might look like, but i just wanted to flag it with this because this was one of the issues that came up without going into too long or belaboring the point. Thats it. Great thank you, director henderson. And just to clarify what what exactly that means, that means that the joint responses are listed. Those explanation options in the grid listed as joint responses to Public Comments. Youre saying some of those do not actually reflect deepas response to the Public Comment. Im just going to say yes because i dont want to go into the whole detail of it. But yes, correct. Okay. Well, we might have to subpoena you to get the full answer. So thatll be for next week before the subpoena comes. Im hopeful that we have of a broader solution that doesnt that that doesnt necessitate a subpoena. Subpoena. Okay. Well well well well keep the ink dry for now on the subpoena. Okay. Seeing no one else in the queue , i will make a motion to adopt and send to meet and confer, subject to our resolution, the number of which im forgetting that commissioner benedicto drafted, which directs the department to negotiate only over those matters that are subject to meet and confer. I think its resolution 2330, but i could be wrong. Im sure our staff will correct it. Second, for members of the public that would like to make Public Comment regarding line item 12, please approach the podium. There is no Public Comment on the motion. Commissioner walker, how do you vote . Yes mr. Walker is yes. Commissioner benedicto yes. Mr. Benedicto is yes. Commissioner yanez. Yes. Commissioner yanez is yes. Commissioner yee yes. Commissioner yee is yes. Vice president carter was still. Yes Vice President stone is. Yes. You have five yeses. Line item 13. Excuse me, line item 13 Public Comment on all matters pertaining to item 15 below closed session, including Public Comment on item 14, vote whether to hold item 15in closed session. If you would like to make Public Comment, please approach the podium. There is no Public Comment. Line item 14 vote on whether to hold item 15in closed session. San francisco administrative code section 67. 10. Action moved to go into closed session. Second all right. On the motion, commissioner walker, how do you vote . Yes commissioner walker is yes. Commissioner benedicto. Yes. Mr. Benedicto is. Yes. Commissioner yanez. Yes. Mr. Yanez is. Yes. Commissioner yee yes. Mr. Yee is. Yes Vice President carter ulverstone. Yes Vice President stone is. Yes. You have five yeses and we are going into closed session 16 vote to elect whether to disclose any or all discussion on item 15 held in closed session. San francisco administrative code section 67. 12. A action motion to not disclose closed session with the exception of factual updates in item 15 c that will be discussed closed in the minutes. Second, for members of the public, they would like to make Public Comment regarding line item 16, please approach the podium. There is no Public Comment on the motion. Commissioner walker, how do you vote . Yes, commissioner walker is yes. Commissioner benedicto yes. Mr. Benedicto is yes. Commissioner yanez. Yes. Commissioner yanez is yes. Commissioner yee yes. Commissioner yee is yes. And Vice President carter oberstar. Yes Vice President stone is. Yes. You have five yeses. Line item 17 adjournment. Bring up person that [laughter]. For me it was we had neighbors growing up that were fold my dad he is raising me wrong for having me pursue the things that are not traditionally female roles. And i think the biggest barrier to anyone in general is when you have cultural norms that make you feel like you cant do something that make you doubt yourself and make you feel you should not be there i dont belong. Those other big efbarriers i think that is the thing to focus on the most is belong everyone should belong here. [music] wishing we trained women grow in production. And recording arts and so we have everything from girls night classes for middle and high school girls. We have Certification Academy program. That would be women and gender [inaudible] adid you tell us. Progress in the internship frm program where they are working in the studios. They are helping to mentor the youth in the Youth Programs and the job place am component. Most of the time we hire interns instructors in our programs and engineer in our studios here. We have conferences we do all overnight country and we have concerts that we feature bay area women and gender artists. [music] [music] an education forward organization. And so advocacy organization. Dedicated to closing the gender gap and the audio and production industries. Started out of the lead answer, why is there a critical gender gap in this industry that started at city college. Why are there so few in this class i was ashamed i did not have the answer being a feminist. Why have i never thought of this i have been in the industry for decades and why have i accept today of all people. It was out of that and unraffling it. Actually started the infernship last fall and just fell in love with all the things about womens oshg mission because we are diverse and so many aspects of audio i did not know and i feel like eyes opened up and i gained a lot of confidence in myself and other fells and queer people in the industry i felt there was more connection and community. Ironically my time in the industry is all pretty good. I think what happened is i was raised by a father who is an engineer. I was comfortable being strounlded by men all the time in his lab i was used to technology. When i got in industry my mentors were men and i saw i had a unique importance that got mow in the place i could be fluent and navigate something difficult and it was the norm for me. What if it was not woman was createed provide it for everybody. Have this environment you are surrounded by technology and people that are going to support you and get you in this industry in a good way. I have been interested in audio i was never trained in music took piano when i was a kid. I never pursued it because not a lot of women doing that. And my family is not musically inclined. When i want to davis the first time i took a music class there were few females in the class. Like a rodey for my dayed was load you will the mixers and monitors and the giant speakers and gigs and help run out the cables and take things down and set up mics i did all of that growing up and never occurred to mow that that was a field they could at all. And then one i could pursue i didnt nobody else was doing temperature my dad and then i go with him to studios and see the men in the studio. Dj for 5 years now and comments you get like wow you are a girl dj that is crazy. That is wild. And i have great moments where it does not happen. And they treat me like easy. Telling mow what to do they correct mow in ways that make me feel less i sprjs the opposite and i notice hands on like you dont know what you are doing rather than asking me. Not consistent times it happens. It is like when i talk to other females they are like say the same things it is like funny i know that nice men dont experience tht main thing triggers me when i experience different treatment and that happens a lot in the audio world. Industry is changing slowly. There is still that issue making the places that are places belonging for everybody. I dont think so. Having a studio where it is not all run by white men like most studios. The studios are only in the word built and run by women. It has been super normalize thered are opportunity for girls and nonbinary people. You go in school and middle and High Schoolers know that this is a field. This is a thing there are many jobs you can have in this field. Some producing pod casts to setting up live shows. There are so many things you can do wee go in and teach the audio skills and give them equipment. I pads and then teach them how to make music and they get to come in here and will getting the tools to people who dont have t. That is really important to me. Thats why i was like wow. I want to be there for other fell and queer people who dont have the opportunity and also to be a mentor for them to really push them to experiment and not going to break it. Does not matter if it sounds bad that is the point to try it. I think it is the goal to see confidence what they are doing and passionate and asking for hymn and excite body learning and excited about making music and it changed my life to realize im callented in the field i can make music without being trained to it it is amazing to be able to be part of that process and ushering women to the field. We can entirely transform how the Technology Part of what you hear every day. We can put xhg something in womens points of view in this every time. It affects the store and he messaging. Think our best example is how we transformed an entire city. Place that major artists on tour one of the men looks likeip dont get it there are woman every where i go and the person was like you are in San Francisco. You like oh , you are right it is here. Most venues have graduates we are grateful to the city for that reason because than i supported us at the beginning. Following your curiosity and interest and dont let anybody get in the way what is presented to you, go for t. No matter what we are here for a reason. Find what it is. Dont let somebody else tell you what it is. You are the oldsmobile one that have been can know when you are supposed to do. Go do it. Television background noise. music . Back in 1981 while the navy base was a homecoming and celebrate and she started free foods in San Francisco and im originally born initially mother was in the military i have been in the navy for years a Planning Commission over in alabama recently and brought over to us and the main ships visually part of this the ships theoretically the coolest part opening through shallow waters. And at a decent time and the main trip when i was in the military and a street name down to the 345i7b and people are very nice and ship will be named after the city they supported us. I think the main thing just for the ships nice to have those but outside of unintelligible navy completely most of stuff on the inside is very, very fast. The first one the blue angles represents our active refers or reserves to integrate with the civilian population and remind us where everyone is and the Aircraft Carrier around the world have no idea they were created in 1946 and actually do that outside of that we have three 5 show sides we have performers and ironically i grew up two blocks south of here i have contact from iraq and my whole family was gathered an hour after serving the country one of the first memories i had. And a lot of opportunities as far as education and traveling some of the honors it is inspiring and really no difference between us and the jets the difference we were represent of the marine corp i feel great for my brooks to go around the world to fly this aircraft. Kind of a push to revise so in 2 thousand 10 in San Francisco meaning the stipulates and planes but he did leadership in the navy and marine corp, you know, what the marine corp. Has a massive disastrously response and what we should do take the patrons and partner up with the governors and started a whole suppressor preamble civilians have response training and education and actually activated and work with the a organizations. The part of this for a decade we have been partnering with local governments basically as long as weve been around. How to mitigate those for earthquake and we participate in exercises throughout the training i guess our plans one of my main functions to let the departments know we are the neighbors and we have been here to help you. And make a friend we want to make sure people know what we are and where we are and the needs what you are capable 6 and so we can help to fill that. music . My hope that people stack shake hands and welcome the men and women no uniform we where their from i think how the cream of crop is involved with the u. S. Carriers and how brilliant the men and women are. And how to help other people with the generosity and the unbuilding help that is important. music . United good afternoon and welcome to the october third, 2023 meeting of the San Francisco board of supervisors. Madam clerk, call the roll. Thank you. Mr. President. Supervisor chan. Present. Supervisor dorsey. Present. Supervisor engardio. Present. Supervisor mandelman. Present. Supervisor melgar. Present. Supervisor supervisor peskin. Present. Supervisor preston. Present. Supervisor ronen. Present. Supervisor safai. Present. Supervisor