The chief and the management time. Were interested to has happen to go firefighters of color. Theres a both a reality and perception of issues and i want to look at the date that were talking about and chief officer rank, when you have 48 percent of the work force thats caucasian and you have 77 percent that are caucasian and in the paramedic, 76 caucasian. Just pointing out the numbers. But let me just make a comment about perception which is i have had many conversations with firefighters of color who feels theres challenges they face within the department and im going to articulate this because the firefighters dont feel comfortable raising this within the command of the Fire Department and this is why breed and cohand and myself feel we need to raise these issues because they dont feel comfortable in a situation where they may be promoted and discussing this more broadly. It doesnt seem as if youre saying theres much we can do and i have to say just given what i know of situations the issues with the promotional test, theres got to be things if were making these great gains with our women firefighters, why is it that we cant figure out this question. I do want to thank breed for raising the language issue. Thats something im concerned constantly. Ive discussed this on a number of occasions with firefighters. In my district, in china town, there have been too many times when i have shown up at fire scenes and im being asked to translate and to get my staff to translate. And its a real problem, so i to so i do want to thank the firefighter, but i want to hear some acknowledgement their theres issues and what the next step might be. Thank you, supervisor chiu. What i like to do is speak to this. The piece that we what we can do and should do and i think what we all agree should be done is develop a diverse pool of qualified individuals from whom the department can hire and who then can form the pool of people would promote to the successful levels within the department. What there is a long history, not just San Francisco, across the nation. Weve surveyed other departments, particularly every large urban agency has a long history of discrimination of people of color and women. The descent decree was a good start. We cant hire based on race in any way. We striving to find testing pools that were obligated to find testing tools that reduce impact. We must follow the guidelines on employee selection procedures which were developed and adopted by the employment and the department of justice. The way we do an exam, its not hey, these are good questions. We have to survey subject Matter Experts which are the individuals doing the exam examine a detailed survey, but what it takes to be successful in the job. What do they do on a day to do basis, how important is it. And then we must design an exam that test for those things that are required on the job. And thats what we do. There are debated all the time. You try to do things like, for example, multiple choice exams. Well have higher levels of that impact. We use video based or simulations which are more like an employee would face when theyre out in the field. But its not possible to design a test that we can guarantee will not have an adversed impact on any group at all. Its not possible to design a test that every employee will think its fair. In case of the litigation you mentioned, the 15 people who werent promoted thought it was fair, but i guarantee you the 240 people that was promoted did think it was fair. That was an age case and its not on the point youre raising here. Im not throwing up my hands at all and we work with our department. We engage National Experts and my recruitment and Public Safety team is now surveying other departments. Do you have great tool we can consider on the promotional side . Im reexcited to continue the testing model which ill talk about because we hire from the pool of people that are there. Theres a lot of largely the hiring is done at the rank order in both the police and Fire Department. How you do on the exam is important. Theres a lot of controversy, well based in what happened historically. Theres concerns that people are cheating or those who designed the test may give information to those who they favor who are in the same ethnic group or their friends so we go to Great Lengths to make sure that cant happen, which gets to the other point which youll touch on now. One item in our Testing Program was identified by the auditors as not Meeting National best practices. To me that determination is surveying several Fire Departments who have good reputations, thats fine. They dont have San Franciscos history. The item they talked about is we develop the answers as the same time the test is administered. Thats important because the people cant provide the answers to the test. It prevents cheating. This was a process that came out the Consent Decree and agreed by the advocacy groups that participated and moving the city toward the Consent Decree and its appropriate to reduce the likely of cheating. Thats not that there can never not cheating. And we take that very seriously. I dont want to say theres nothing we can do, but were doing a lot and its not the case that things are in disarray as it would appear from the report or were not following this practice by any stretch. I want to make two final comments. I have respect, mrs. Kelly for the work you do and youre trying your best and i have respect for the chief and what shes doing. I moved to the city 18 years ago to work for group that created the lawsuit. Theres a perception and a reality in the numbers that this is still a problem. And the fact of the matter is, it doesnt allow us to have direct affirmative programs race is a protected class. We had to cough up 40 million based on a program theyre recommending that needs to be revamp. I want to make sure were doing all we can to limit our legal liability as well as make sure we do have the Fire Department up and down looks like San Francisco. But i want to again, i know you are trying your best, so i want to say that publicly. Supervisor tang has something to say. Thank you director cohen and my question will help you into your next segment. Speaking to supervisor chiu original point. I believe recruitment is important and it impacts what happens in terms of promotions so is im excited our city is moving to this continuance testing model so in the next segment of your presentation, if you can show us how dhr is work with the Fire Department and how its ongoing. Because i know the budget an hift report did point out the budget Analyst Report shows the lack of who is in charge. If you can address that. We have we intend to follow the model in our continuous testing for the Fire Department. We disagree with the analyst that there is a lack of clarity as to who does what. I assigned our chief of policy with the background communication to develop the materials to assist the Police Department. And theyve been using those materials. We gave them Interest Groups and invited them in and says heres materials, would you like to use them. We have a video on on the website and the Police Website and on the dhr website. They talk about the testing method and how do you take the test and it gives examples so people can see what the Testing Process is like and it describes the process in great detail. We started in early november and we have no adversed impact on the passing rate of the exam which is great news and its a diverse pool we have the show rate, which is the rate at which people show up to take the test is much higher than it was for the old exams and higher than the rate that was shown that was included in the report in 2009 particularly for protected groups. Those rates were 30 and 40. We are upwards up 90 percent for the Police Examination so far. Its really exciting and the Police Department seems pleased. Well work closely with the firefighter. Well rely on the firefighters the firefighters that the chief assigns to help recruit now that well have a recruitment to do. And we will be providing materials in support and certainly all these jobs are posted on the website. The beauty is its an ongoing recruitment. The list is continuously refreshed by people who take the test. Okay. This is an answer to the question that chair breed had. That the San Francisco firefighter set the flier to more than 100 organizations and will submit a less. Supervise are cohen has a question. This is where im struggling when listening to this. There is no acknowledge nor do i have a desire to a desire to change, to move from one direction into another. There is an independent audit that is saying two dhr and to the Fire Department, there needs to be change that needs to happen. You also have a legal challenge that is also evidence saying, hey, theres something thats happening in your testing that needs to change. And i dont hear in the in your testimony and your testing, an acknowledge. Weve identified two problems. Theres an exam problem and evaluation and where and how were recruiting, but i dont hear a desire to move in that direction or acknowledge, yes, we hear what saying and were incorporating the feedback and this is a direction were going to go in. This is an example that refer to often and i think it drives home the point. If you were looking to recruit african americans, then youre going to africans congregate, where they socialize and youre empowering people if it is in the department or outside the department to act as an agent to search out, to find the best of the best. And its like going to the grocery store, right. When we want eggs, we go where the eggs are. We dont go to the bread section or to the pace tree section. Were doing great in this area, but we can do better. I would like to begin to hear more conversation on what are we doing to create pathways to careers within the Fire Department that represents our ethnic communities that we share. Examine i do want to take a moment to highlight the accomplishments of the department. 15 percent women, i think you said. 16. Thats phenomenal when you think of the total population of women that are in the industry. Its only seven percent, so youre doing something correct. We need to duplicate that in other parts of the i dont have the numbers in front of me. We need to duplicate that when it comes to the ethnic community. And the city does a great job of putting that out. They say, if you speak a different language, well pay you more and well look closely to your application. Thats the same level of uniformity that i would like to see in the recruitment of future fire employees. Also i want to talk about the report the report talk was the imbalance of staffing between fire and ems or employees. May i defer those questions to the chief because were not involved in the staff. Not a problem. We can wait for the chief to get up. I would like to ask about one of the recommendations that was made this is recommendation 1. 3 and it is to make sure that the recommendations has been clarified through dhr and the Fire Department. This talks about discrepancy within staff and your department and where that responsibility lies. Your recommendation on this recommendation, you indicated that you disagree. And you stay that both dhr and the Fire Department are clear on its recruitment responsibilities. Can you talk to me about that clarity because its not clear to me . Sure. Let me say that so on we have i have not we are changing if the weve adopted a testing module and were able to host recruitments. What when did when did you adopt it . Last month. This is a new thing. Its absolutely new. We were engaged in the conversation. We were able to go forward with police first because their eligible list was expiring sooner so we started there and we did not need a Civil Service rule change. It is the next big thing and were hosting. Were able to people dont have to go to the Testing Facilities in the region, weave been hosting testing and we can invite people from the Community College and if they have people, we want them to do that. What are the responsibilities, who is doing what . What we have done we plan to repeat that Police Excuse me, in fire. The first thing we do is prepare materials. We have the posting and the announcements and in this case we created business cards. Mrs. Guard created business cards and posted videos to make it more accessible. With he provided that to the police we provided that to the Police Department and the constituent groups who were interested and we have them available. Were posting it and providing the information. Examine if a group ask is us, we can host a test in the Mission District on Caesar Chavez and thanks to the board, were fixing up a little bit, so it has greater capacity. Thats a big change and im sorry if you did not hear that we want to change because in 2009 when i saw that, despite sending fliers out to 100 groups and getting a diverse pool, we werent satisfied with what we got and its note in the report that the group is more diverse than 2009. Were going down a different road. Is dhr responsible for that . For which . The model . Yes. Dhr is under the charter and civil rule responsible for examinations. So we adopted this method of examination and brought it to mr. Crouse identified it. We brought it to the chief and the Fire Department. We brought it to the fire commission. We preview it had with interest grouped and other membership groups in the Fire Department and we achieve the rule change and its our intention to move forward in the spring sdmrchlt dhr is responsible for examination . Exactly. Who is responsible for recruitment . We provide materials to the department. We can support them, but the department does recruitment. Do you prior to last month, have you what materials have you provided . Well, there has been no recruitment. Its very disheartening to go to a community and say, dont you want to be a firefighter and theres no test in the future. Its a waste. That was our concern with the report. We get kas gated for not keeping a lively recruit, its a waste of effort and it on be unfair for candidates. So theyre going to wait around for two years. We can host groups and we totally support groups turning people out and we will host as many administrations of the exam as we want in San Francisco. Just so im walking away from this. Dhr main responsibility is to manage the examination function . Exactly. So the Succession Planning doesnt fall on you speaker we have our Work Force Development unit. And we work departments on succession efforts and we do a work force we give reports to the department on who is likely to retire and we work with they work with other units in dhr, and Labor Relations to provide apprentice programs, but the department is responsible under the charter and they decide where they need to put their resources. Again, im trying to process this. When you say you support them, youre giving them the data saying youre going to have five people to retire. And the department is responsible for saying, thank you dhr. Do they put it in writing or is it an internal body . Its not a centralized function. Were supporting the efforts. We dont require reports from departments. The Public Health commission asked us to do a presentation on Succession Plan and we gave the materials and told them we would consult with them and there has been consolidation, but its more of a support from dhr. My final question, what kind of feedback do you need to hear or from what entity do you need to hear from to change the testing mechanism that you have . What is it going to change . Youve heard people editorials from the chronicle examine the court has spoken on a desire to see a change in testing, this audit has expressed a desire to see a change in testing, so what does the department of dhr, you as the director need to hear, see, what more evidence, what else do you need for this change to happen . I think many people are operating under a misconception of what the findings have been. The exam about which there were a ruling by a jury was the it was administered in 2008 and the issue had to do with score corrections and lack of clarity in the score corrections. Process that was used at the time is no longer used by dhr and we retain the scratch paper which is what the jury wanted to see. Weve made that change. The other issue, the only issue that came up in this audit is about the practice that weve adopted. It didnt come out of thin air. It came out of the Consent Decree to prevent cheating which is apart of the exam and the answer key. We dont want to change that. The experts say dont change that. If we change it, were going to spend time talk beginning security violations and so and so gave the answers to mb. We dont want that. Weve had that. We really dont want to change that. We have made the change years ago that led to, i think, the misunderstanding associated with that case that has been referenced in that the that has been reported on. But the whats the internal process to change something . Any exam. Any testing. We just decide to change it if it has a legal implication, we would talk to the legal department. We might say, for example, in the sheriffs department, we found a new video exam thats a good way to assess integrity. The Testing Process belongs to dhr. I will say that we continue to search for improved testing mechanism. We believe we are been doing it correctly and its natural that those who hasnt been successful is going to disagree with that. Im sorry for that, but its our job to look for better mechanisms and were still doing that. Thank you. I want one of our plans im reminded, to go back to the Succession Planning question that you asks, we always are a list available. Its going to address our ability more quickly and well have a list that well move to and fill positions. The other part is there were no fire exam administrations, so there were acting assignments that people werent allowed to take. They were given assignments based on sinority. Theyre challenging that process and thats their right and we respect that right. We feel like weve done a fair process and if someone disagrees and if we believe we havent, well change it. Its a fluid process and were always looking for new tools and i challenge my team to do a National Search and look were doing how many people are on this team . On our Public Safety team . John. Five. Are they Public Safety experts. Examination experts. Thats independent of our miscellaneous examination team. Who would be testing for things like custodian. Got it. Do you have anything else from your presentation. Yes. We have a list for the chair of the organizations that were contacted. You can continue your presentation. Thank you. I want to just discuss a couple of points that were made. I think that the i want to point out that savings that were that the savings there have been no grieve answers to i dont know how you save money. Whats the lawsuit about . That is in process. We have not paid money. So i think its pretty con jekt youll that theyll be money saves. Nationally, weve done a better job than, i think, of any other Fire Department and our Testing Program, we produce job related test that conform to state and National Standards which my team and i are proud of. They feel like theyve been under the gun and i want to on commend them because theyre devoted. And they spent their careers putting together exams that are fair and i want to recognize them. My final point i have a concern that the report was released to the press before it was released publicly and released to the responding department. Do you know who did that . I dont know. I raised my concern with the budget and legislative analysis but i was concerned about that. We was told that the report had been made public. It hasnt been received by the members of the board of supervisors and it was only received by dhr and the the Fire Department in draft form. We received it. As you can tell from my presentation, we were working hard to get changes. We did not proe