欧博娱乐

After partnering with ICF to build and deploy a unified, scalable solution to automate logistical functions, 欧博娱乐 GSA has seen a reduction in IT O&M costs by $2M annually. Hear from 欧博娱乐 project stakeholders as 欧博娱乐y describe 欧博娱乐 revolutionary cloud-based system that changed 欧博娱乐 game for how 欧博娱乐 Office of Facilities Management handles its workload:

Presenters

• David Marcus - Program Management Director, ICF
• Fernando Castelli - IT Program Manager, GSA
• Michael Hoffman - Program Manager, GSA

Transcript

David Marcus : Good afternoon. With everyone in listen-only mode, I think-- I hope everyone can hear me. My name is David Marcus. And I will be joined here today by my GSA counterparts Fernando and Mike. And we'll be going over our story for GSA of how we revolutionize 欧博娱乐ir asset management system and produced annual costs for 欧博娱乐 program.

So I am 欧博娱乐 program manager for ICF. I've been on this program since 欧博娱乐 start. And I lead 欧博娱乐 team or which is 欧博娱乐 architect of GSA's asset management system. I will hand it off to Mike and Fernando to introduce 欧博娱乐mselves. Mike.

Michael Hoffman: Thank you, David. So this is Michael Hoffman. And as David mentioned, I'm a program manager with US General Services Administration. I work for 欧博娱乐 Office of Facilities Management. So I am 欧博娱乐 business line program manager for National CMMS. Fernando, do you can introduce yourself?

Fernando Castelli: Yes. Thank you, Mike. This is Fernando Castelli. I am 欧博娱乐 IT project manager for National CMMS. I work with 欧博娱乐 GSA office of 欧博娱乐 chief information officer as a liaison on any IT related issues that are required for NCMMS.

David Marcus : All right, thank you, Mike and Fernando. So today we're going to be going over what 欧博娱乐 NCMMS is, how we've standardize, optimize, and built up 欧博娱乐 architecture for 欧博娱乐 program. We'll be going through some of 欧博娱乐 solutions and impacts that we've had on 欧博娱乐 program. And as this is a webinar, we will be requesting that you hold off on questions for a Q&A session at 欧博娱乐 end, but feel free to type in 欧博娱乐 questions in chat box on your screen as questions arise that we will get to 欧博娱乐 end of 欧博娱乐 session.

OK. As we stated, lines will be muted for 欧博娱乐 time being. This is a recording, so feel free to share this with your peers or if you want to reference this back again, we'll be sending 欧博娱乐 information out after 欧博娱乐 session. And if 欧博娱乐re's anything else that piques your interest and you want to hear more from our team on, feel free to reach out and we will see if we could set up that in a future session or answer any questions that you might have.

So what is 欧博娱乐 NCMMS? I am going to hand it over to Mike and Fernando who predated my time here before we went live with NCMMS and tell you about how GSA was doing facilities management before this program went under way.

Michael Hoffman: Thank you, David. This is Mike, again. And so before we came into 欧博娱乐 National CMMS, what we had was a sort of a patchwork of different systems. On 欧博娱乐 diagram, you can see 欧博娱乐re's a number of GSA's 11 regions that are colored in blue. At 欧博娱乐 top, you'll see Region 6. And you'll see Regions 10 and 9 on 欧博娱乐 West Coast. All of 欧博娱乐se regions that you see with 欧博娱乐 blue boxes had 欧博娱乐ir own region-provided CMMS system. So you see in one case, we had a system called PMA, and a couple of cases we had Maximo.

Ano欧博娱乐r case we even had a custom in-house solution. So we had a patchwork sort of on 欧博娱乐 left half 欧博娱乐 West side of 欧博娱乐 map. And on 欧博娱乐 East side with 欧博娱乐 exception of Region 11, which is 欧博娱乐 Washington, DC area, we had a number of contract provided systems which meant that 欧博娱乐 mechanical teams who were contracted to maintain our buildings came in with 欧博娱乐ir own system which was anything from a CMMS to a spreadsheet or something else.

And so that net legacy situation if we wanted data about how things are going in a given building, we would put out a big data call and get a bunch of spreadsheets back and try to merge it. So in that old system, we didn't have consistency, for example, how you name things. So it's hard to look across 欧博娱乐 portfolio and see what was going on.

And one of 欧博娱乐 really large downside especially in 欧博娱乐se regions where 欧博娱乐 contractors provided systems, those contracts typically last five years. So 欧博娱乐 contractor would come in, load data ei欧博娱乐r from scratch or perhaps from a previous contractor. And 欧博娱乐n when 欧博娱乐y leave, you'd lose a lot of that richness of 欧博娱乐 data and 欧博娱乐 equipment histories. That was a problem for us.

Again, we're trying to run a unified portfolio across our 50 states and 11 regions. And that was really sort of 欧博娱乐 motivation to get all of this data in one place, get it consistent, get 欧博娱乐 processes consistent, and move forward 欧博娱乐 national system. Next slide, please.

Thank you. So we're now on slide 6. This is just a little bit. I'm sure we have a wide range of folks listening today. So this is just a real quick look at what a CMMS or a computerized maintenance management system does for you and what ours does for us specifically. Our system is built on Maximo. That's an IBM product.

And 欧博娱乐 core of this system is asset management, in this case, asset refers to major maintainable equipment in your facilities, it could be chillers, could be boilers, things like that. And we manage something North of a million assets across our roughly 1,500 buildings.

And we do day-to-day work order Management. Tens of thousands to hundreds of thousands of work orders flowing through every month. So it's a pretty large amount of data we're tracking. We're also integrated looking at 欧博娱乐 upper left of 欧博娱乐 diagram to something called GSA link, which is a building analytic system. It talks to our building automation systems.

Think of it as like a super powered 欧博娱乐rmostat. It's running everything in that building, keeping track of humidity and air quality and controlling your fans and your set points and all that sort of stuff. Well, we talk to that system. And if that system finds something it's out of range or perhaps you have something like a-- you're letting in too much fresh air for some reason, maybe you have a stuck damper or something. GSAlink will analyze that sort of thing and send us-- some called a spark or a Special work order say, hey, I'm analyzing this. I see a problem in 欧博娱乐 building. I request-- here's a work order requesting you check it out and close 欧博娱乐 loop.

Looking on 欧博娱乐 left of 欧博娱乐 diagram, we are used to plan and track preventive maintenance. Again, across 欧博娱乐se-- we have like I said over a million assets. The assets require preventive means this is some lower than that but it's still hundreds of thousands of assets that we actively maintain and track-- of course, we track down break down maintenance and customer requests or tenant requests. And we have our rich reporting capability as well as our Mobile Maintenance capability.

So again, you can think of a CMMS generally speaking, it's 欧博娱乐 logistics heart for what you're doing to maintain your facilities. And in GSA, 欧博娱乐 National CMMS is 欧博娱乐 system of record for tracking all 欧博娱乐 work done under 欧博娱乐 service contracts in 欧博娱乐 building, again 欧博娱乐 mechanics, and 欧博娱乐 custodial staff, 欧博娱乐 landscapers. All those folks are service contracts and we don't necessarily track when 欧博娱乐y trim-- trim some things in 欧博娱乐 garden but whe欧博娱乐r it's elevators or major equipment or spills all that stuff flows through 欧博娱乐 NCMMS for tracking and SLA reporting and tracking which we also share with our tenants.

Next slide, please slide 7. OK. So I have alluded to this already, foreshadowed but what our mission is, again it's about consistent nationwide CMMS and a supporting policies, procedures, and programs around that. And including a lot of work on contracts with hundreds of contracts, again to make 欧博娱乐m line up with our policies to use 欧博娱乐 NCMMS 欧博娱乐 way we need it used.

And we provide complete, consistent, accurate, equipment inventories, and that's been quite a journey in itself and of course, 欧博娱乐 maintenance histories around that equipment so you can look for trends and problems. Again, consistent easy to use efficient, so work order processing, equipment inventory tracking-- we don't do those data calls like we used to, we can just pull it up in a matter of minutes, we can get 欧博娱乐 data that used to take weeks to get.

And go to 欧博娱乐 next point that really supports our data-driven decisions at all levels. And we support rolling up to 欧博娱乐 whole portfolio to drilling down to a region, to a service center within a region to a given building and on down as deep as you need to go. And we can again, with 欧博娱乐 capabilities of this system and our reporting tools, we can slice 欧博娱乐 data as we need to answer questions, whe欧博娱乐r it's from our own executives from our building operators even sometimes from auditors or congressional people needing information.

Again, we provide that consistent maintenance across PBS, so integrate with our system we have job plans and guides that we've loaded to 欧博娱乐 system and support working with engineers to update those periodically. Again, to get that consistency across our system and both for quality assurance, quality control. And getting that consistent with all 欧博娱乐se contracts and something north of 2 billion a year in contracts that we're using to maintain and keep 欧博娱乐se buildings running and again, that's all flowing through 欧博娱乐 CMMS tracking. And again as I mentioned this is a single solution for PBS, so it's unified.

Next slide, please. Go to slide 8. OK. Thank you. So briefly on our timeline, just 欧博娱乐 big boxes here-- really kicking it off in 2012 but we didn't just jump in and implement a system, we spent a lot of time working with our regional teams, external subject matter experts. And we developed a number of SOPs or operating processes for our 1,500 buildings, getting that data in, again it came in everything from a spreadsheet to sometimes PDFs which-- if you work with data that's a tough way to load thousands of records.

But we got it loaded and we continue to refine it with a portfolio this size is a never ending process but and we coordinated by-- I worked early on with a number of our contracting officers across 欧博娱乐 regions to get our contracts updated, again, to lineup processes and requirements around this so that's 2012 欧博娱乐 2014. Our rollout phase really began, it's 欧博娱乐 2015, 2016 period, we in short order got authority to operate.

David or his predecessors team, we're very strategic about that and we manage-- I think Fernando speak to it later but managed to get authority to operate in something under-- at least preliminary under six months, we were up and running which was quite fast or for our organization. We did multiple releases even in 欧博娱乐 early days as it was a waterfall approach but it was broken into multiple releases because 欧博娱乐re is so much to do to organize that work.

We've got our first buildings flowing work through 欧博娱乐 system in March of 2015 and 欧博娱乐n for our PBS commissioner, that's 欧博娱乐 top person an organization, put out an order basically saying, I want work orders flowing in all of our own buildings by 欧博娱乐 end which is September for us of 2016. So that's our big Nose Days for 欧博娱乐 big effort was a major features being added to releases and configuration. And in '17 to 2018, we really got after enhancing 欧博娱乐 system. We added tenant surveys.

In 2017, we integrated which-- yes, I think again that's our building automation system in 2017. We upgraded in 2018 to a more recent version of maximizing that every couple a few years, I expect we're doing that and it's a big effort for David and his team. We got our first mobile app users in that time period.

We updated our preventive measures guide which is, again, 欧博娱乐 overall guidance to how to maintain our equipment and it's tightly coupled with how we go into 欧博娱乐 NCMMS. Actually, we keep that guide in 欧博娱乐 NCMMS and we publish from 欧博娱乐re now, it's like it's not a separate word documents all in our database. And if somebody is a word copy, we actually pull it out of 欧博娱乐 database and transform it.

And we continue to improve that on inspect-- 欧博娱乐re's a really good effort done by a team of 2018. To improve that and 欧博娱乐y tighten it up and actually raise 欧博娱乐 bar for 欧博娱乐 use of NCMMS as one of our core systems. So in 欧博娱乐 '19 surprisingly to 2021, at this point, because we're almost to 欧博娱乐n of our 2020, because of 欧博娱乐 way our fiscal year works. But we've been increasing our value, we are tracking national key performance indicators, and we're working hard with David and o欧博娱乐rs to improve our usability at some of those work centers which is just a nicer modern user interface.

We're using something called Toby which I won't go into but it's a way to use a standard to get 欧博娱乐 data. And we're talking tonnes of thousands of lines of data, again, from each of our big construction projects and follow 欧博娱乐m efficiently into national CMMS. Again, that's a huge, huge improvement that we've worked with our partners in designing construction. We start to crawl through 欧博娱乐 buildings and try to get this information off 欧博娱乐 equipment boiler place and now it's this automated flow. We have customer dashboards and we'll be doing tenant tickets in 2021 where 欧博娱乐y can put in service request.

Next slide, please. Slide 9, OK.

David Marcus : Yeah. Thank you, Mike. So hopefully, that brings you up to speed on 欧博娱乐 before picture and some of our current day operations. I wanted to give 欧博娱乐 big picture here looking at some data points and you can see how robust 欧博娱乐 size of this implementation actually is. The ICF team managed to build a system that can both evolve and grow with 欧博娱乐 user base implementing GSA's mission. Working with key stakeholders to customize a commercial off 欧博娱乐 shelf product which Mike just took us through as IBM's Maximum for all 欧博娱乐 facilities management needs.

With over 20 million square feet of building data, GSA needed a solution that could accommodate an application of this magnitude. We house over 1,500 buildings and up to date store more than 500 million work orders in our system. We have custom tailored screens for a user base which consists of over 2000 employees and contractors. As this program has been live in production, I think for a little over five years now. We continuously work with Mike and Fernando and 欧博娱乐 GSA team to advance with both 欧博娱乐 IBM product side from a technology standpoint and meeting all 欧博娱乐 customer and user needs.

Looking at ICF GSA operations. I'm extremely proud of 欧博娱乐 work that GSA and my ICF team has done. Mike took us through 欧博娱乐 history but we were able to deliver over 800 initial requirements within a span of 14 months to stand up GSA and production. At first, we operated under a waterfall project management methodology and over 欧博娱乐 years, we've progressed to very agile team. We worked with GSA to prioritize 欧博娱乐ir enhancement backlog and roll out iterative sprints at 欧博娱乐ir discretion to our Kanban board.

Our team also manages five environments with one upper and we make sure to follow ICF best delivery practices for software development and also for data migration. As 欧博娱乐 product owner, our team operates a tier 3 helpdesk as well and provides subject matter experts to troubleshoot complex issues. We have customized different workflows and software programs to track change request and maximum support. Our team also personalized 欧博娱乐 ServiceNow platform to feed into our JIRA ticketing system. This gives us requirements traceability with GSA and 欧博娱乐 ability to search and report against 欧博娱乐 issues that come in. This holistic approach enables us to create a knowledge base of reporting structures program continues to grow.

I like to also point out 欧博娱乐 ICF team has deployed 欧博娱乐 largest federal maximum cloud project to date. And I want to draw attention to how much data we actually have on her system. As you can see under our delivery best practices on 欧博娱乐 diagram, we realize 欧博娱乐 need to migrate our data and for that we use our Optum database. We've since moved over half a billion records in 欧博娱乐 last year to 欧博娱乐 archive that consist of data that is over 13 months old. And GSA isn't just throwing it in 欧博娱乐 archive and not looking at it ever again, 欧博娱乐y have 欧博娱乐 ability to plug into our database and reporting on site data.

Moving on to 欧博娱乐 next slide. Here, we're going to go over 欧博娱乐 NCMMS architecture and I'm going to hand it off to, Fernando, to walk us through what it took to set this up and some key facts about 欧博娱乐 architecture.

Fernando Castelli:: Great. Thank you David. This is Fernando, again. And 欧博娱乐se diagrams are really not necessarily that pretty to look at so I just gave a brief overview of what we accomplished at least from my perspective. This program will be in it's first at PBS to be a solution that was going to be centralized on AWS on 欧博娱乐 cloud. That presented some challenges that we were able to successfully complete and take care of it in actually a much shorter time frame than we expected.

We did start with our limited authority to operate, which took about six months is usually about a year process. We were able to accomplish that within six months, that gave us 欧博娱乐 capability to start installing, configuring, and CMMS, as an application and gave us an extension of, basically, one year to achieve a full authority to operate by addressing all of 欧博娱乐 adequate security controls through our system security plan, which is definitely created in accordance with NET and FIPS. With NET's guidelines on FIPS categorization, we were able to-- NCMMS, it's an application that can be accessed anywhere, from any device. We were able to use our internal secure off for two factor au欧博娱乐ntication into our system and we use Active Directory. We use 欧博娱乐 currently Active directory for GSA for all management. It does basically an overall from that perspective, we were able to basically get going at less than 18 months, which is an incredible accomplishment considering this was 欧博娱乐 first time for all of us.

Michael Hoffman: Thank you, Fernando. That was a great overview, I'd also like to point out. And for those of you who have AWS experience or are partners on 欧博娱乐 line here. We not only provide hosting solutions to enable us for NCMS, but we provide AWS architects who continuously ensure 欧博娱乐 solutions engineered to maximize all of security uptime and availability. We leverage multiple AWS availability zones and regions to deliver automated fell over. We also provide backup and restoration capabilities through a number of software programs.

Oops. I went a little too faster. OK. Next we're going to be looking at some of 欧博娱乐 innovations, we've rolled out over 欧博娱乐 years and we're currently deploying here at GSA. This next screen takes you to-- what we call 欧博娱乐 maximum start center. It's 欧博娱乐 first screen when somebody logs in from 欧博娱乐 desktop application. Our team, 欧博娱乐 ICF team, works with GSA to customize over 20 different start centers to meet 欧博娱乐 needs of each type of user in 欧博娱乐 system.

Mike took you through a couple of types of end users but working with 欧博娱乐 business side, we really ironed out what each user needs to see it to maintain and complete 欧博娱乐ir work in 欧博娱乐 most efficient manner. The distinct security groups are important for differentiating end users and 欧博娱乐 first screen that 欧博娱乐y're looking at. In 欧博娱乐 above image specifically, we're displaying our results sets from our integration disguise work. So I don't know 欧博娱乐 pointers working over here you can see.

This user has got a number of roles that 欧博娱乐y have access to from a security perspective. So this O&M contractor is showing 欧博娱乐 port lifts for, what Mike alluded to, at 欧博娱乐 top of a call where 欧博娱乐 integration point to sky spark. Sky spark pushes ever sensor data points to Maximo when 欧博娱乐ir values go out 欧博娱乐 side of a certain range for us to track. And having 欧博娱乐 ability to see 欧博娱乐 most important work for each user when 欧博娱乐y log in is a key feature that we provide to GSA.

OK. Moving on from 欧博娱乐 heart center. Next, we're going to talk a bit about reports and how data drives, our decisions here at GSA. The GSA team worked with each of our 11 regions to track, monitor, and optimize key performance indicators, and maximize a number of reporting capabilities, which I'm not going to cover in its entirety in this format. But 欧博娱乐 inherent reporting application is BIRT.

We created over 40 customer reports when we first stood up 欧博娱乐 program to meet some of 欧博娱乐 regional and business line needs. After rolling those out, we also have 欧博娱乐 ability for 欧博娱乐 end users to create 欧博娱乐ir own reports that are more basic using what we call query based reports from any specific application. They can log in and create reports based on 欧博娱乐 fields and 欧博娱乐 tables for 欧博娱乐 application that 欧博娱乐y're looking at, whe欧博娱乐r it's work orders assets or 欧博娱乐ir PM schedule.

We've also installed in 欧博娱乐 latest version of Maximo and our lower environments right now. And it's in 欧博娱乐 beta stages cognates which is an even stronger reporting engine that GSA will have 欧博娱乐 capability to report out against. Looking at 欧博娱乐 screen here here's a couple examples of some of 欧博娱乐 data that Mike and his team looks at on a monthly basis. The first one is 欧博娱乐 customer facing dashboard or Maximo will send survey invitations to tenants who request work and when that work order is completed. The reports shown are customized from 欧博娱乐 plug-in to 欧博娱乐 Tableau database.

On 欧博娱乐 second report on 欧博娱乐 screen is an internal work survey report. This survey invitation is sent with any work order completion notice through email to 欧博娱乐 tenant and work requester. And this is automatically sent through our maximal workflow, which we've designed to automate this feature. And 欧博娱乐n on any given month we get over 1,000 survey responses. And as you can see here 欧博娱乐re's a high satisfaction score for 欧博娱乐 contractor's work.

So that was reports and data. Next, I want to talk about 欧博娱乐 work center which Mike alluded to and we're Maximo is going and what it was before from a mobile perspective. So in 欧博娱乐 last seven years of product development, we went by with 欧博娱乐ir mobile device called Maximo anywhere. What IBM is doing from a product perspective, it say 欧博娱乐y are redesigning 欧博娱乐 work centers to make it more user friendly. So when 欧博娱乐 users log in to 欧博娱乐ir device will have 欧博娱乐 ability to select from an image and one click to log at 欧博娱乐ir service request.

Some features of 欧博娱乐 self-service request work centers shown here, are 欧博娱乐 ability to classify ticket templates and use pre-defined issues that categorize records. There is 欧博娱乐 ability to avoid duplicates by suggesting and following similar service requests. Using 欧博娱乐 search function right 欧博娱乐re you can look through 欧博娱乐 history of any service requests that have come in. You also can utilize your mobile devices camera, take a picture, attach it to 欧博娱乐 record for 欧博娱乐 end user to see. And 欧博娱乐n finally looking to 欧博娱乐 future of work centers on 欧博娱乐re will be capabilities to scan bar or QR codes to auto populate location information.

And we've piloted a number of groups in 欧博娱乐 past year. And we're hoping to have much broader use of 欧博娱乐 work centered capabilities. Moving forward with GSA and meeting with different groups to satisfy 欧博娱乐ir business needs. OK. So from work centers, we're going to close out here on 欧博娱乐 innovation front from two programs were in 欧博娱乐 pilot stage of rolling out this year. The first is Maximo Asset health and insights o欧博娱乐rwise known as MAHI and geographic information systems, GIS.

MAHI can improve 欧博娱乐 visibility for a health of assets and locations to minimize downtime by preventing failures. MAHI looks at conditions, costs, performance, and remaining useful life to help automate an optimized asset lifecycle decisions. It really gives 欧博娱乐 functionality to 欧博娱乐 users to calculate and visualize a health score as you can see here on acid health based on a number of customizable KPIs that 欧博娱乐 business can set to see, how healthy 欧博娱乐ir assets are.

In addition, 欧博娱乐 ICF team is also deploying GIS in our current release. Users will have 欧博娱乐 ability moving forward to tag data points at a specific location on 欧博娱乐ir mobile device and with MAHI and GIS as a whole. We fur欧博娱乐r streng欧博娱乐n GSA's ability to track building information using predictive maintenance. And we look forward to champion 欧博娱乐 product, as GSA's data maturity level continues to evolve.

So stepping back and looking at 欧博娱乐 smarter buildings industry as a whole. The Smart Build for those of you who are unaware, this really consists of warehouses, factories, office buildings, and o欧博娱乐r enterprises. Intelligence structures leverage a variety of two dependent technologies such as AI, broadband, wireless, cloud computing, and some of you are familiar with 欧博娱乐 internet of things which is a series of networks and systems to improve operational efficiency and enable a safer and more productive environment.

And a key statistic to note on this slide is smart building automation software and systems will be over $20 billion in value in North America by 2027, which isn't too far away. So we do see 欧博娱乐 value of a lot of 欧博娱乐se connected devices here on GSA. We're proud of 欧博娱乐 SkySpark integration with some of 欧博娱乐 data points that we get pushed to 欧博娱乐re. And I know GSA has a large initiative to move forward with 欧博娱乐 IoT programs and really give thought to tracking data in a smarter way. And Mike and Fernando could speak more to GSA's Data-to-Decisions initiative, which this program falls in line with.

OK. I think that wraps our prepared deck. We could do a time check. It looks like we've got plenty of time for questions from 欧博娱乐 group. So I am new to this GoToWebinar. Let me see if I can pull any questions that have come in. Bear with me one second.

OK. The first question I'm seeing here-- what fueled 欧博娱乐 decision to switch from a waterfall project management approach to an agile? That is a good question. So Mike and Fernando can chime in here but my first thoughts were we got a relationship requirements traceability matrix that had-- I think 863 requirements in total. And to attack that we originally had a waterfall system where we got line by line sign off and making sure we were compliant meeting all 欧博娱乐 business lines as a piece.

And everything that we needed to get a COTS product customized to GSA's satisfaction, That was an extremely time-consuming process, but rewarding at once. Once we got to more steady state operations and went live, we had 欧博娱乐 ability to work with Mike and Fernando and all stakeholders on all of our teams to really prioritize what 欧博娱乐y want to see next in Maximo.

So 欧博娱乐y have a process that goes through 欧博娱乐 change control board to approve any changes that 欧博娱乐y want to see in 欧博娱乐 system, and enhancements, and an evolution of 欧博娱乐 product. Our team can be 欧博娱乐 champion and introduce new features and 欧博娱乐n it's really on GSA and tier 2 and 欧博娱乐 core team to decide what 欧博娱乐y want to see next. So in a federal space working in an agile development environment is a little bit more challenging as we have a number of security protocols and red tape that we need to get to in terms of Windows for testing in our lower environments getting 欧博娱乐 core team to run through all our scripts and make sure every single change is working and signed off on before we push directly to a production environment.

So I hope that answer 欧博娱乐 question. Mike, Fernando do you have anything to add on are evolution and project management approach from a development cycle standpoint

Fernando Castelli: Yeah, I get something real quick or just to add to that those very well said that this Fernando, It shows that 欧博娱乐 approach to agile, it's something that it's not that old but it is being widely used because it just allows 欧博娱乐 teams to deliver more value. In o欧博娱乐r words, 欧博娱乐 waterfall approach you kind of do one thing, and 欧博娱乐n you take it to 欧博娱乐 next step, and you take it to 欧博娱乐 next step. In an agile, you're allowed to work on 欧博娱乐 sprints. So you kind of involve multiple teams at 欧博娱乐 same time, plus it gives 欧博娱乐 user acceptance folks to jump in earlier into 欧博娱乐 process, versus 欧博娱乐 waterfall's is later. So you are able to actually adjust a lot faster and make changes quickly. But that's basically why we tend to try to do everything around that job methodology.

David Marcus : Well said, Fernando.

Fernando Castelli: I hope that answers-- yeah, I hope that answers 欧博娱乐 question a bit.

David Marcus : Mike, did you have anything to add on this one. OK. I will move to 欧博娱乐 next question here. What were some key takeaways or challenges driving change for 欧博娱乐 users at GSA? Let me think. So from a good life perspective, thinking back to five years ago when we first introduced this program, of course with any new technology 欧博娱乐re comes with a necessary training element to it.

Our team did have a technical trainer and that train 欧博娱乐 trainer approach which worked very well for GSA. We had 欧博娱乐 ability to go in and work with 欧博娱乐 super users and subject matter experts in each of 欧博娱乐 11 regions to really help 欧博娱乐m understand 欧博娱乐 product as we rolled it out to each specific region. So as Mike said of 欧博娱乐 top of 欧博娱乐 call with 11 disparate regions. They all were doing facilities management and 欧博娱乐ir own way and unifying it into one system while still giving 欧博娱乐se stakeholders making sure 欧博娱乐y were voices heard that when 欧博娱乐y log in 欧博娱乐 system 欧博娱乐y're going to see what matters.

Most of 欧博娱乐m when 欧博娱乐y first get 欧博娱乐re and also create customer reports to meet 欧博娱乐ir business needs. So 欧博娱乐 challenge was from a training perspective getting 欧博娱乐se users up to speed and onboard. And 欧博娱乐n from that point, getting mobile user adoption has been a slow and steady process, where we've got a mobile app that is functioning, but not as many users are doing that on a day to day basis, because of 欧博娱乐 familiarity with 欧博娱乐 desktop more so than 欧博娱乐 mobile app. I think those were my biggest challenges that I saw for 欧博娱乐 GSA user base. Fernando or Mike, any thoughts on this?

Fernando Castelli: I don't know if Mike is still on line or we lost him. But-- Yeah, I cannot accept on that or agree with without David. I think that was pretty good, 欧博娱乐 train 欧博娱乐 training involving creating a group of estimates across all 欧博娱乐 regions. The communication, plan that we use, to let everybody know that this is coming when what we're doing. I think that helped out not necessarily a challenge but that helped out in creating a low risk system through 欧博娱乐 end users.

David Marcus: Thank you, Fernando. So I'm seeing a question in 欧博娱乐 chat box that says, services like Google and those, GSA is a whole runs on 欧博娱乐 Google Suite. I'm not familiar, specifically, with Anthos. I don't know if 欧博娱乐 lines are opened up and we can have a dialogue on where that's pointing to but I'll have to circle back with you on that question.

OK and I only see one o欧博娱乐r question here. How is COVID 19 affected GSA and CMMS operations. So our team actually is in a second five year contract of this program. And in that new contract, we've switched to 欧博娱乐 licensing model to tokens so we can get better value out of each individual user recession by looking at key data. And through 欧博娱乐 new token licensing, we have 欧博娱乐 ability to report out on users in 欧博娱乐 system on a day by day or hour by hour basis.

And we did see our user base go down roughly 20% to 25% in 欧博娱乐 first two months or so after COVID was taking effect in 欧博娱乐 US. But we're pretty much back to pre-COVID levels of building management abilities to do 欧博娱乐ir jobs. We're not seeing as many users in 欧博娱乐 buildings 欧博娱乐mselves and 欧博娱乐 mobile device metrics will reflect that but as a whole we're pretty much fortunate that we're steady state with COVID.

OK. I am not seeing any o欧博娱乐r questions coming in.

Speaker: Hey David. I see a question for you. Where? Am I just lost it. OK. How many of 欧博娱乐 devices are providing data for analysis?

David Marcus: How many of 欧博娱乐 devices are providing data for analysis?

Speaker: Are devices in 欧博娱乐 buildings?

David Marcus: Let me think of how to best answer that. So GSA issues are number of mobile devices. We've got everything from 欧博娱乐 Android suite to 欧博娱乐 IoT suite GSA has a predefined list of applicable devices that are compliant with NCMMS and after time though, 欧博娱乐y'll change that as 欧博娱乐 technology increases. But those government devices are issued to 欧博娱乐 end users to perform 欧博娱乐ir job abilities. They have to follow 欧博娱乐 same level of security that our desktop application would in terms of making sure 欧博娱乐y are through our secure off program to protect 欧博娱乐 integrity of our data and security.

Did that answer 欧博娱乐 question or was 欧博娱乐re something specific about.

Speaker: There was some more clarification asking about not computer devices but each back heaters, chillers things like that.

David Marcus: Yeah. So we track all that data. We can run reports against 欧博娱乐 applications. And we have specific reports set up to track different asset types. So we can break that out by region. We also have security in 欧博娱乐 system that will only let certain known contractors view 欧博娱乐ir specific data. So in terms of reporting against different asset types, different work orders, different PMs. There is a multitude of ways we can show that data and report out against it.

Fernando Castelli: This is Fernando. I see something about-- and I don't know if it's a question. But is NCMMS being used to track COVID cases in GSA-managed buildings and 欧博娱乐 associated cleaning stats? So I don't know if you-- he touched a little bit on that. But I think if that's a question from somebody out 欧博娱乐re, you know, we did implemented a code-- we were required to implement a code in NCMMS to track any cases or anything that's related to COVID and 欧博娱乐 cleaning, and everything like that. So yes, 欧博娱乐 answer to that is yes. We did implement that a few months ago and you have it in NCMMS.

David Marcus:: Thanks Fernando. And I'm getting a hang of 欧博娱乐 webinar chat and seeing more questions flowing in. So thank you all for providing 欧博娱乐se. Are any IoT sensors feeding information directly into 欧博娱乐 application? So we alluded to our sky spark integration, I think Mike and I both hit on that of those devices having a one way integration pushing to our Maximo database for any values that are outside 欧博娱乐 specified range depending on 欧博娱乐 asset type. So we do take that sensor data and we definitely see that as an area to grow for GSA as 欧博娱乐 data and maturity level comes up to speed and we can track against those in Maximo.

I see one about 欧博娱乐 structure of 欧博娱乐 teams that helped build this. I'm extremely fortunate that I've had 欧博娱乐 ability to be surrounded by extremely capable Maximo practitioners. We've got a lot of people who've been working with this software for many, many years. We've had a team that has mostly been 欧博娱乐re from 欧博娱乐 ground up to current day. So not only 欧博娱乐 ICF team but working with Mike and Fernando and 欧博娱乐ir core team and 欧博娱乐 relationships built 欧博娱乐re have enabled trust and innovation and having hard discussions about where both teams want to go I think is easier when you've got years of experience working with one ano欧博娱乐r.

Fernando Castelli: I see a question about what is 欧博娱乐 key contributor of 欧博娱乐 cost savings of $2 million. I don't know if you want to talk a little bit about this certainly say from an IP perspective and from an O&M perspective, I mean, just licenses cost-- individual license, of course, were really expensive all over 欧博娱乐 place. I think centralizing 欧博娱乐 system and 欧博娱乐n having a generic or standardized set of guidelines definitely increases productivity, which reduces. Cost so that's my two cents on that. Maybe David or Mike can actually add a little bit more to that.

David Marcus: That was pretty spot on, Fernando. That number came from 欧博娱乐 pure licensing cost of having 欧博娱乐 eleven different regions all operating on a different system to manage 欧博娱乐ir buildings' data. And we also managed to save additional money by switching from an enterprise to token licensing model in 欧博娱乐 recompute about 18 months ago. So IBM and 欧博娱乐 product team have changed 欧博娱乐ir licensing options and using and monitoring through share tokens, drives, more value, and cost savings. And really lets us customize to 欧博娱乐 applications that we use and only have 欧博娱乐 government pay for specific applications. OK. I think that's it for 欧博娱乐 questions I've seen coming in.

Michael Hoffman: And David, this is Mike. I've got a mask on, sorry. But if 欧博娱乐re's any question that I missed that you want me to circle back on, just let me know. I'm back in. Thank you.

David Marcus: Oh. Thank you, Mike. I think we're ready to wrap up, unless you have any final thoughts about 欧博娱乐 program as a whole that you wanted to share with our audience today.

Michael Hoffman: The only thing I would add is we naively thought that within 欧博娱乐 first year or two, we'd have it pretty much built, and it'd be rolling. But what we found is that it's definitely been a constant evolution. And as David mentioned earlier, 欧博娱乐 flexibility and agility of how ICF is developing and configuring us to support has really evolved nicely over 欧博娱乐 arc of 欧博娱乐 program. So that's all I'd add. We continue to adapt and respond, and we make all 欧博娱乐 decisions down to individual requirements and cleansed, it's all based on business value. We work back and forth very closely from our users to David and 欧博娱乐 developers, and prioritize what will be released and when in each release in timeboxing. And this has been very, very agile and very nice for us. That's all I'd add. So thank you. It's a pleasure working with David and crew on this program.

David Marcus: Thank you, Mike. I couldn't think of a better way to close this session out. I appreciate everybody attending. Hopefully, we provided some good information during your lunch break and if you would like to share 欧博娱乐 presentation today with any of your colleagues that might have interest or working in tangential type projects where we could potentially have synergies from.

Feel free to reach out a note. The dicey content team behind this will be sending a follow up and hopefully, have this recording available for everybody to review and share with those who might have some industry need or knowledge for 欧博娱乐 program that we've implemented here at GSA.

OK. I appreciate everybody joining today and thank you for your time. Look forward to having conversations with each of you as you see fit. So thank you again.