Effect relationship with the cost sharing is kind of broken. I think the primary negative effect of all this, d. T. Customers dont understand what they are paying for and according to our survey, they want to understand what they are paying for and want to choose what services they are getting from d. T. So another way that d. T. Recovers costs is through what ill call projectbased work orders. So, this is funding that is to Cover Service requests that cant be accomplished within the baseline recoveries. However, as i just said, no definition for whats in Baseline Services so its really up to the d. T. Division managers when they get a Service Request to determine whether or not it can be accomplished in their baseline budget. And so we reviewed these project work orders, and we found that less than half had any documentation that would describe the work effort or the schedule or the basis for costs, and even when that documentation was available, it was often missing such key information, and this is just inconsistent with the work order guidelines and makes it difficult for the department to plan and prioritize work. Finally on financial management, we had findings related to contracting. So, as you know, d. T. Manages several citywide contracts for i. T. Services, but until the end of 2016, they did not track the contracts, despite 2012 audit recommending to do so. During the audit, we looked at the d. T. Contract management data, manually compiled into a spreadsheet and found it problematic on several fronts. Number one, we could not determine the remaining Spending Authority on the active contracts just by looking at their contract data. And in addition to that, even though it was compiled in a spreadsheet, it was not in a fully functional contract management database that would do things like notify you if a contract was about to expire. So, we noted, for example, there was 35 contracts that had expired but under which services were still being performed at the time of the audit. And we also noted a case where a vendor had to notify d. T. Of the pending expiration and the renewal cost was not in d. T. Budget, so a scramble for resources to make sure the contract was renewed on time, and that there were appropriate funds for the services that other departments were relying on. The other thing ill say about contracts, too, they often lacked cost controls, work, deliverables not to exceed amounts and performance measures. Customer service, found inconsistency, providing clear explanations to the customers with the services they are getting and the level of support they could expect and as miss campbell mentioned, d. T. Was in the midst of just rolling out a new Service Management system and was working through the implementation of that new system. And then finally, looked at the project management office, or p. M. O. That was created about three years ago to manage high priority i. T. Projects. And what we found was that number one, it did not have a clearly defined role what it should do to marshall resources, and in addition to that, p. M. O. Did not have access to project budget and expenditure information and did not in some cases accurately or consistently report on the status of projects. And so we thought all that really impaired the core mission, which is to manage i. T. Projects and we have specific recommendations about how to improve the p. M. O. And i think its just really important to mention that, because as you all know, i. T. Projects are expensive and very high risk for the city. Its important to get that right. So i think the overall conclusion of the audit and of the recommendations which you can find in the report are that d. T. Should improve its financial controls for contracting and charges, and needs to regularly obtain input from customers, clear explanation of services, and better define the role of the p. M. O. And i think these recommendations which the department mostly agrees with will improve the value of d. T. Services and make it more Effective Service provider for other city departments. With that, i thank the department. They worked really well with us throughout the audit and it was an excellent working relationship. Happy to take questions now or thank you, nick. I think that is all set forth in the audit report and appreciate your work, i think it was helpful and constructive, which is what audits should do. They are not gotcha things. Miss drurel. Welcome. Good afternoon. It is now afternoon and maybe you can just start with for everybodys edification, just the breadth of everything that d. T. Does. I dont think everybody realizes how widespread the scope of what you all do is and i think that might be a helpful jumping off point. Ok. Well, thank you, supervisors for this opportunity. As your new, servings as your new city c. I. O. , it is a pleasure to be here. D. T. Does a wide range of activities and services for the departments, everything from s. F. Govtv, im sorry, the connection here in the chamber is down, but it is being broadcast out to the public, so thats not interrupted, but its like having a power point, you know, you come up to do a power point and it wants to misbehave on the one time you need it. So, this is appropriate that it misbehave right now. So, d. T. Provides the s. F. Govtv services, networking services, data centers service, a wide range of enterprise application services, project management we discussed and also public safety, all the radios for the 800 megahertz system used by Law Enforcement and fire, as well as all the external cabling that is done to provide dark fiber to the city buildings. So, its not a large team but its a mighty team, a very dedicated Technology Professionals that are committed to providing Excellent Service to the city departments. We do support 55 departments so at times we have to juggle priorities. Its always a challenge to prioritize our work and i think thats something that i hope we can make more transparent, which is what is involved in this audit. So just moving forward, i want to say thank you again for being here. I have served as a c. I. O. For eight years for pierce county, washington. I have 30 years managing technology and technologists. I have completed my first 100 days of service and i hope that i will be able to provide the stable and longterm leadership that the city is looking for. I want to make sure our infrastructure and services are up to date. Cost effective, and secure. And we will also be ensuring that we provide Excellent Customer Service to the city departments and the public i want to thank severin, and the team. The list of horribles would probably make any c. I. O. Run, but the d. T. Team has leaned into the audit, incorporated recommendations and solutions for the audit findings in the d. T. Strategic plan, which you have a onepage handout, kind of looks like this, that describes the initiatives and actually some of the projects that d. T. Is working on in fiscal year 1718. We have acted on all of the recommendations from the audit, and we have provided the supervisors with a matrix that talks to and speaks to the response, our comment and an update, which shows the majority of the recommendations with actions completed for their improvement. So all of these process improvements that have been suggested and recommended. Again, we are taking every action we can to make these improvements. I would like to stress that improvement is all a continuous process and we will continue to work on these over time. I want to highlight some of our accomplishments in our recommendations back to the Audit Committee of what we have been able to address. In the areas of customer service, we have prepared Service Level agreements and we have prepared a rate book that describes how rates are calculated that has been shared with the departments. We have ensured that our Service Level agreements are implemented in our Service Tracking system, which is service now. We retired an older ticketing system, so the new system should be much more capable of providing that transparency. Our staff time has our staff time management has shifted from an obsolete on track internal system to the citywide peoplesoft system. A way to have transparency by using a common and standard system in the city. And we are refining our analysis of expenditures and recoveries in order to provide the mayor with timely information for our budget process. And i will say to the Audit Committee, i think one of the things thats important to understand when we Start Talking about chargebacks and the whole concept of chargeback models is that there are instances where a chargeback model built on f. T. E. Base in a department is appropriate when it is something such as network utilization, and things that are standard across the infrastructure and then there are those times when the work orders are appropriate, when they are doing particular work for a department, and we are trying to make a bright line between those two. On the contracting side, d. T. Is exploring the use of contract and supply management features in the new peoplesoft financial system. This will give us the ability to manage the contracts. In response to the request for new procurement policies, we have updated or creating purchasing travel reimbursement guidelines. Updating training materials on the checklists how to do d. T. Procurements, and most interestingly, i have participated in these, initiated procurement training with o. C. A. And the City Attorney with d. T. Managers and thats helpful to understand procurements and to work to make process improvements in that area. In the area of work orders, we are implementing our new interdepartmental Service Agreements and templates that prompts for line item budget, delivery timeline, scope of work and the basis for cost, that those will be documented for the work orders. We have procedures and policies drafted that are compatible with the controllers new peoplesoft system so we need to leverage that technology and the capability of that system to improve our business process and we will do that, and are doing that. In the areas of project manager that was discussed, we are evaluating our resource and staffing priorities and we must support our Core Functions and projects. We have implemented formal protocols on Planning Project management and scope definition, which is very important to making sure that you deliver a particular widget on time and dont end up with a neverending project. We have trained staff on invoice review procedures to ensure that Business Owners and their delegates review prior to payment and color coded status and demand management reports shared with the departments. On the staffing side, we have high scores, 70 agree on personal motivation and involvement in engagement with management in the department, we have continued to make improvements. We have had 100 staff participation in a selfand supervisor assessment program, this is something i initiated, this is not something that was done before i came on board. We are increasing performance evaluation reporting to the entire department, one of my objectives, well on the way doing that. Increasing transparency in c. I. O. Decisions so staffing changes and changes to process that im implementing are communicated to every level in the organization. We have renewed our Online Training program, and we are encouraging staff to request skills improvement training. So, in conclusion, i want to thank david german, leah levinson, the Technology Staff that is with me here today, on preparing for this audit review and hearing. The whole d. T. Team has really embraced the audit, and is actively working on improving their processes. Right now there is a meeting going on where the Strategic Plan i shared with you is going into what we call a deep dive, so we are actually working with each one of the divisions and reviewing each individual project and have that dashboard, color coded dashboard to review and im aware where each project is. Thank you for the opportunity to present and i certainly look forward to working with all of you on Technology Projects for the city. So, im happy to answer any questions. Thank you, linda. Colleagues . I do have a few questions. So, thank so much, for presenting today. And it feels like you know, theres quite a bit of work that needs to be done, but im glad that we are moving towards a process of addressing it. I had, i wanted to bring up somewhat separate concern, although related to this audit, which is expense of our licensed Software Usage here in San Francisco and i know i bring this up all the time at the Board Meeting when we have licensed software contracts that come before the board. And its really not a criticism on each individual contract, but just the citys overall vision and work on what we are doing at reducing our reliance on licensed software, paid licensed software and the work we are doing to figure out which systems need to be on licensed software and which are on free or open source. This is something ive been bringing up continually since at least 2011, and neither of you were on the board when i first began speaking about this. But i do think that government spends an inordinate amount of money on licensed software, some we have to do, probably not other times of operating systems that we can include that isnt paid licensed software. But some of which i think we could wean ourselves off of and save the city millions of dollars, you know, taxpayer dollars. So what i want to ask the department of technology and this has come up in previous years, but what has been the continuing discussion and vision about how we can relook at how we do licensed software here in San Francisco. Im happy to address that, and i agree with you, i have always been a proponent for open source solutions, having said that, open source is a unique type of software implementation, and its not just about the, how the software is coded, it is the infrastructure thats around it. So, having said that, i know there have been discussions with the p. U. C. About their use of open Source Software. They have demonstrated that they are using open source. And quite honestly, the Biggest Software system that d. T. Supports, or did support, is an open source product. You may not be aware, the citys entire web presence, both internal and external, is on druple, an open source environment. So i think that shows the commitment to that type of technology. Having said that, we also need to recognize that druple is widely supported, has a very Large Community of support that makes it viable. So i think as we move forward and talk about how we make technology choices, i am always going to come down on the side of reliability, sustainability, and its ability to be improved and stay secure into the future. I think an open source project needs to demonstrate that just like we would require that of a vendor and i think we look forward to lowering our license costs by also starting to use more standards. So, really adopting a strategy that says lets look at the portfolio, the Technology Portfolio that we have today. Lets use the Software Technology we have in place today. Lets expand that. We gain so much when we do that through training thats already in place, support thats already in place. All we have to do is expand a bit of capacity and its operational as opposed to a complete implementation. So, im an advocate for, lets always before we implement something totally new, and i know there are lots of industry conferences that people go to and come home with a new shiny widget, lets look at what we have in the city. The more we can standardize, the more we can share data. You heard the conversation this morning about shared data. The more we share systems, the more we share data. Thank you so much for that response and i think its great the website is operated on open source, im not sure everything should be open source although i question whether licensed software is more secure than open source, in particular given what we are seeing in the National Headlines what we assumed were the most secure agencies in the country that is getting hacked. But i think its that is the answer that ive gotten before, that its something thats being examined, that we look at it. I guess i want to understand if we are going to establish protocol so we start to see less licensed software contracts come before the board of supervisors. I guess i have not seen that reduction yet. And so im not sure if departments are seriously examining the options. One great example is the fact all of our emails on microsoft outlook. There are clearly other Free Email Software thats out there that other government uses, and so you know, there are just some easier ones that seems we are not tackling. I get it with the recent, for example, the recent p. C. Contract with oracle that came through, there probably is not a lot of open Source Software that deals with bill management and construction communications. Seems like for some very specific types of operating systems we will have to pay for licensed software, but for stuff like microsoft word and email, there clearly are other free options that are available to the city where you know, i think security is probably equal between paid and unpaid. And im just wondering why we havent been examining the resources so we can save our taxpayer dollars and put them towards street cleaning. So, i can address that. I think you have to look at the total cost of ownership on any project and you also need to look at integration, which we have also heard can be crippling when the