Putting the Ops in DevOps – An Infrastructure Story

Come learn how a large scale fortune 100 company is infusing DevOps principles into Infrastructure engineering even though DevOps has had a strong presence for many years at Nationwide Insurance. Hear the story of “Putting the Ops in DevOps” after many years of DevOps adoption for our Software Development community. Come on the journey of how infrastructure teams both support Software teams while at the same time need to think about their own product orientation to drive efficiency for the software we serve and the company products we sell. We will illustrate the guiding principles, building blocks and playbooks used to embrace DevOps “Product Principles” and improve how we build, ship, and run our infrastructure in partnership with our software teams.


Attendees will get a perspective of Product Taxonomy at a large fortune 100 company and the complexity of defining products in world that consists of business products, software products, platform as a product, and the journey maps and customer experiences they enable.


See how the equation of Lean+Agile+DevOps is being implemented for Infrastructure teams and how we transformed the way we price and deliver our infrastructure at Nationwide.

SF

Stephen Farley

Vice President – Infrastructure and Operations, Nationwide Insurance

Transcript

00:00:13

Thank you, Michael. So over the years, we've heard numerous times from leaders from nationwide insurance or the largest mutually held insurance companies in the United States. They spoken at DevOps enterprise five times, including at the first two us conferences we heard from Carmen Diardo, Jim Graff Meyer and Cindy Payne. And more recently we've heard from the amazing audit team from nationwide Clarissa, Lucas and rusty Lewis talked about how to make your auditors, your new best friends. I am so delighted that this year Steve Filey will be presenting on the continuation of the nationwide journey. So until 18 months ago, he was VP of technology where he guided over 200 software development teams as part of the software development services organization, from which so many of the stories that were featured here at this conference came from. But for whatever reason, 18 months ago, he became VP of infrastructure and operations responsible for the uptime, availability and costs of the platforms that each one of those 200 teams use to manage run on. He is now responsible for all technology infrastructure, including networking, switching, storage, mainframes, and so forth, as well as he 1000 technologists that make it all happen. I'm grateful to him for teaching me about teaching Thursdays at nationwide, where everyone is required to either learn something or teach something which made it into the devil's handbook in 2016. I'm so delighted that Steve will be able to talk about why he was offered this new role and what he's done since then. Here's Steve.

00:01:48

Thank you very much, Jean. Uh, happy to be here at DevOps enterprise summit 2021. Um, as Jean mentioned, we've been here many times from nationwide and, uh, happy to be back and tell a little bit different story. I'll tell you a little bit about myself, um, kind of how I got into this infrastructure role in this story, but really this is a story of our journey in dev ops, which started many, many years ago and how maybe we left infrastructure behind and what we're doing to bring infrastructure into the picture. And, uh, as James said, my new role is vice president of infrastructure and operations. While we know as hosted solutions, hosting solutions in nationwide. And I spent, you know, um, over 30 years in, in, at nationwide in the it industry, all on the software development side of the house, it's all was about building software and building solutions for people.

00:02:41

And 18 months ago, close to two years ago, I was given the opportunity to take a new role at nationwide, which was to lead infrastructure operations. And, um, in my prior role, as we've spoken here before, and I'll tell part of this story is we had been on a multi-year journey to infuse lean agile DevOps principles into, well over 200 now 300 agile teams across nationwide. And, uh, it was very rewarding for me. You'll hear a little bit about that story, but the story I'm going to tell today is about how we really brought infrastructure teams into the fold. As I mentioned, I've been here a long, long time, uh, graduated in computer technology from Ohio state university, the Ohio state university, and, uh, hold my insurance designation. I follow my designation, uh, very proud of that working for an insurance and financial services company, uh, so that I have context to the business, you know, as I was building software throughout the years, but, uh, and leading software organizations, uh, interesting fun facts.

00:03:38

So if you ever get a chance to, you know, I wish we were in person out in Vegas, but if you ever to get a chance to kind of meet me, I'm a second generation, um, by marriage at nationwide, my father-in-law was a nationwide agent for many, many years. My wife works here at nationwide as a, as a release manager and very fun fact of the day is anybody who loves horses. Come talk to me about, uh, have a small horse farm, uh, just north of here in Columbus, Ohio. So just a little bit about me and, you know, uh, give, uh, some credit here about things that have influenced me mostly over the last 10 years. And you can see a little credit to Jean, their DevOps handbook, the Phoenix project, uh, some credits and Mick Kirsten and the project to product as both Jean and mech have presented here at nationwide.

00:04:21

And what we know as now called tech expo was called tech con uh, at our conferences, uh, as we've worked that journey. And then a little bit of context about nationwide. So a lot of people don't know we are a fortune 100 company, uh, in insurance and financial services. We have some of our, the money side of the equation of $46 billion in sales, on an annualized basis, uh, assets of $274 million. Uh, we have an investment portfolio of $125 billion. Uh, we're actually number one in what we know is public sector 4 57 retirement plan, uh, management. We're actually number one in pet insurance. Uh, we're number one in sharing farms and ranches, which I hold a foreign policy myself, uh, on my little horse farm. And so we do a lot of great things, a big company. Uh, so this is, uh, an at-scale kind of conversation today, uh, with that said you can see the context of nationwide technology as well.

00:05:20

So, you know, we, we have about 8,400 technology workforce of associates and contractors working on our technology on a regular basis. Uh, we're articulating now about 300 plus software development, agile teams. We call lines here at nationwide. We spend a little north of a billion dollars in annual it expense and across many technologies. We have everything as gene, uh, would have alluded to. We have mainframes, we have distributed technologies, we have cloud hosted technologies. We have record keeping systems, digital solutions, mobile apps, uh pro-lifer of what we call technologies, uh, for this context today kind of pay attention to, we have 60 plus infrastructure, product teams or teams, uh, and that's a pretty new number to us. We just now articulated what does product mean to our infrastructure teams? And next up is this has been our journey. So this is what Jean would have alluded to in our prior presentations.

00:06:19

It traces way back to about the 2000 pre 2011 era when agile was coming on in the scene. And we made our way through that evolution. And, you know, in about 2014, we had about 50 agile software development teams working in traditional agile best practices and fashion co located a sprint based scrum based, um, fashion. And then 2016 hit. And this word dev ops came on the scene. And if you look at that 2018 number, we actually had 200 plus teams or 86% of them were defined as mature and agile and many dev ops practices clearly, you know, from a lean principle. And you can see the perspective, you know, we believe in all things, transparency, gemba, walks, accountability, systems of accountability, systems of transparency, visual management, uh, and you can see those intersections that exist with agile, uh, that we have around those principles and practices.

00:07:19

And you can see, you know, some of the detailed agile principles and practices in the yellow section of the slide, but it was really for illustrator purposes. We were doing this as we started to tear down that separation of, of siloed plan build and run mindsets and get into those away from those vertical practices to horizontal improvement of full stack, build it run at type of teams. Uh, so we believe that dev ops was a set of practices and mechanisms that facilitated continuous delivery and support of our already existing lean management systems, uh, and our, uh, recognition that we needed to go faster. And then if you look at kind of what was happening, I can do this build out here of the slides and you can see around that circuit 2000, we were still a dominant waterfall type of company. Um, and we were doing physical hardware provisioning.

00:08:14

Um, we evolved to those iterative solution practices, uh, agile, uh, moving into, uh, you know, some early water scrum fall practices were, which often were not healthy. Um, but we that's how we evolved into it. And here we are, and circuits 2020 around continuous delivery with dev ops. And you can see, I drew a pink circle off on the right, uh, not red pink, because it's not like red in trouble, but it's, Hey, we need to focus on the infrastructure components and how do we infuse and transform our infrastructure environment as well. So starting with infrastructure automation and getting into this concept of product centric, uh, infrastructure and centric implementation, which is really what the rest of the talk is all about. When I came to the infrastructure teams 18 months ago, I felt like something was missing. I actually had somewhat of a guilty feeling like, oh, uh, you know, I was so indexed on the software side of the house that I may have not been paying the right attention to that ops word.

00:09:17

That's the key component of dev ops. And like, what are the infrastructure tooling teams doing to not only infuse themselves with the software teams, but also to become a dev ops themselves or become lean and agile themselves within the products that they are responsible for? Uh, uh, we had just come off a presentation by Mik Kersten, uh, on the book project, a product. And we said, well, product seems to be the place to go, that we need to organize around the principles and mindsets, and this could be our catalyst. And in that mindset, we need to use all the things that are disposable from our learnings over the last 10 years, and really bring them all forward, uh, for our infrastructure teams. And we said, well, why do we want to take this journey from an industry perspective? So we're seeing strong emergence in product centricity and product focus in the industry.

00:10:13

We're getting positive feedback. Um, we, we're seeing better quality from teams who truly own their build and run together with full accountability for their product product teams who, uh, demonstrated lead lead time improvement or speed improvement when they own the entire life cycle. And it actually fostered better employee engagement overall. So as we headed into this, we said, well, what are our challenges? You know, well, one of the biggest challenges we face, and one of the things I could use help from this community is what is the definition of product. So, you know, if you're coming from a software company compared to an insurance company, compared to any other company in the industry, definition of product is complex, is it a homeowner's insurance policy? Is it a, uh, annuity or life insurance policy or a pet policy? Uh, the other challenge is, is our technology is tightly coupled, and it's very decentralized in how we build software and manifest infrastructure.

00:11:15

So how would we define our products in a tightly coupled world was very, uh, interesting conversation. And so those kind of independent assets that are owned across the company from a technology perspective, um, they made it difficult to understand the true value stream independence that we may or may not have. We just felt that, you know, enabling full-stack product capability would drive a lot of unit cost improvement for us in the time where we needed efficiency in our it organization and where we needed efficiency across the company. Uh, we felt like we could drive organizational efficiency well and the design of product teams. Um, but we knew designing what we call a product taxonomy would be difficult. And we needed to do that in partnership with finance, because one of the key elements of this product centric model was how do we charge for our, our, our products?

00:12:10

You know, how do you unitize them? And I'll talk about that and how do you actually bring transparency to what people want to pay for and what they are paying for so that good decisions can be happening by the consumers of your products. Uh, so these are all the things, uh, that we thought about of why the product model seemed right for us. What did we want to get out of this? So we knew the three biggest outcomes that we thought we could get out of this is we could actually get labor related savings. We could bring efficiency to organizational alignment and structure. We could organize around full stack teams and we could drive, uh, labor related savings and how we deliver the work against our products. The second thing is really key. We could get product stack savings in the form of hardware and software, and then one of the most important things.

00:12:59

But one of the hardest things to harvest is, is productivity by both development teams who use our products, but also productivity by the teams ourselves, as we build, run, ship our own products that get consumed by the software development community, uh, next was the tough, tough part, which is, well, what is a product, uh, you know, for an infrastructure team and how do we think about product at nationwide? This slide we built that says, okay, everything that we know from the industry is product takes on many forms. And at nationwide, we talk about this all the time, and everybody has a different perspective on what is that product. So, you know, you could go all the way to the left. It could be at a customer experience, uh, in the middle there, it could be a business product like a homeowner's policy. Uh, uh, it could be something like an annuity product that we sell in financial services.

00:13:56

But more importantly, as you look through the dev ops lens as an it leader, what it meant to me was there's some software product orientation as well. And there's some technology platform, product orientation as well. And where did we fit in this ecosystem within nationwide and infrastructure? Uh, so where we landed in infrastructure and operations is that we want to treat our products as technology products or products as a platform. So first up is we had to understand our products. We had to create focus. We had to establish mindset. What does it mean to be a product manager, uh, of an infrastructure platform? And what is it, you know, what are those guiding principles and what does it mean to leverage lean agile and dev ops? So, you know, part of that was mindset training for a bunch of new roles that we define, which we went through role definition.

00:14:47

So now we have technology product managers, uh, of our, and we said, Hey, you know, in order to be a product manager, you have to own all the components of the product. You have to have sustainable operations, you have to be paying attention to unit cost and drive unit costs. You have to understand your SLS and your metrics, uh, and, and you have to understand the complete life cycle. And you have to create feedback loops to drive customer feedback. So everything around the circle represents the mindset of what we wanted product managers to be accountable for no longer do we plan it, throw it over the wall to a build team who then throws it over the wall to, uh, run it team. And, um, you know, this is complete product management for the products we defined. We also said the guiding principles needed to be anchored to, we wanted industry leading competitive costs that meant unitizing our products.

00:15:42

How do we want to charge for our products in the form of a unit and the, how do we work with our finance and our CFO teams to actually build what we called a financial simplification model, to be able to outwardly charge for the consumption of our products. Uh, we wanted to drive speed. We wanted to drive availability. We wanted to improve feedback loops of how did people like our, our, our products and how did they actually weigh in on the backlog of our products. And then we needed to transform how we deliver those products. And this is a key element of infusing, you know, lean and agile and dev ops and the infrastructure teams. We ended up with 44 product teams that gets supported by 26 service teams. A product team has to be a team that truly build ships and runs a product that delivers something that's unitized and paid for by consumers, a services team, or many of the teams that help foster the adoption of those products, the experiences with those products, the success of those products, and helps people be successful across a very large organization.

00:16:48

So we, we worked through a taxonomy that started with what is a product suite, what is a product grouping? What is a product at the lowest level that gets unitized in that we charge for? And how do we create the, the, the hierarchy or the relationship of those three connotations? So on the left-hand side, we tend to organize around product suites. And this is how we departmentalize our organization. On the right-hand side, we tend to unitize at the lowest level and charge for our products. And again, these are representative products that we literally unitized and said, these are the things that we build ship and run. These are the things that we will improve through product evolution, uh, independent of if these things are on-prem or in the cloud. And how do we actually help consumers understand how they're consuming these products and pay for these products?

00:17:40

Um, so this, that was what we mean by product as a platform. These are the platforms we service and run. Uh, they change over time, uh, as new things come in, event streaming, for example is fairly new over the last couple of years for us. Uh, as that, um, came into play, uh, for us, um, lots of storage solutions, lots of compute type solutions, lots of database types of solutions that we charge for and independently. And here's an example of what we did for identity and access management. And actually, uh, one of the members of my team, Todd Beckley is had given another dev ops summit presentation around moving identity and access management specifically to a product model. And that meant some pretty good coupling with our CSO office and our information risk man, our information risk management office around their definition of product. So our IRM office, uh, basically had defined product as a capability and said, we need to drive capability based products.

00:18:44

And one of their products is identity and access management. Now we spilled ship and run very specific platforms related to that. And we actually have three products, sub products that we build ship and run, but it has a direct correlation to the product model that our, our CSO office in our information, same thing, information, risk management office has, but you know, those alignments are really important. Uh, you can see on the right, the result of that, which is we're able to articulate the cost per ID of an internal ID, uh, and they cost them an ID for an external ID. And, uh, we hit, this is a product that we do an allocated model on. We don't unitize it, but you can see, we could easily get there and say, okay, well, who do we want to charge $260 per idea. That's what it costs to manage this across both the security office and the infrastructure product office, all right.

00:19:40

New roles critical. So, you know, if you're going to be a product manager, you have to have roles in the organization that actually set the stage for what should a product manager do. So we, we mapped over 700 associates and we moved from 14 to eight roles. We introduced new roles in this journey. Uh, one called a technology product manager, um, away from what used to be like a general engineering leader, engineering manager to a defined technology, product manager. Uh, we also inserted new roles. Uh, we cleaned up some of the basic engineering roles, but we also insert a new roles like a technology delivery leader. Uh, you'll not see us use the word project manager in our infrastructure teams, uh, as we moved from project to product thinking. So we moved to technology delivery leader. Uh, we put in solution engineering roles, uh, and we put in a TSP technology services, practitioner role site, reliability engineers emerged and came into play as did a role called technology delivery professional.

00:20:47

Um, and that is a role likened to the scrum master role in the industry that, that we embraced on the software side of the house. But we wanted to make a leap of faith into kind of the next generation of what that represented and say, Hey, this is a role that we want to be able to also contribute to the work of the product team, uh, to be engineering grounded, um, but also guide, uh, those best practices of the team. So not just, um, you know, a best practices from a lean agile and dev ops, but truly anchor to engineering and the product that they support. So went through a pretty massive role, um, change, uh, to help people understand the expectations of the work that they did and the role that they held. The next big thing was really building a foundation and helping people learn.

00:21:36

So rolling out things like a lean management system, some common language, some learning paths for both leaders and associates. And you'll see kind of what we did in that. How did we get beyond, you know, project thinking in our portfolio and get into product centric, thinking in our portfolio, and then how do we get financially ready? What I mentioned earlier around a fence and model to help, you know, bring transparency of the cost of the products and allow our consumers, the software teams and the business solution area, it teams to understand, you know, what they're paying for. And that's what we call it. Our FinCEN model for financial simplification, learning paths for associates and leaders. We actually partnered with a local, uh, uh, community college university, Columbus state community college. And we built a, we built a series of training of what does it mean to, uh, learn some of these new techniques.

00:22:29

And we actually, uh, we, we fund this and we get tuition reimbursement for our associates who go and get certified. And these capability, it's a certification program that takes 31 to 56 weeks, but really deep rooted technology learning. And what does it mean to think the way a product century can think some of the DevOps practices, so you can see, you know, we teach things like what is infrastructure of code with infrastructure as code, as it relates to get hub and source code management and some of the new networking, uh, capabilities in cloud basics and, uh, infusing a developer mindset into infrastructure teams with a tool around developer tools and mindset. Uh, so those were core partnerships to try to transform the organization and move it forward. This was a key element, was unitizing our products and working with our finance awful office to bring transparency and, and cost recovery.

00:23:25

So we basically pay for these products, we know the cost of the full stack product, and then we unitize it and recover the cost of those products in our charge structure to those who consume the product. Um, we also decided, well, we need to understand what a product stack looks like, and this is kind of representative of that. And it says, here are the drivers of product unit costs. Part of it is what does it takes to operate the product? You know, we could have incidents, we have patching and vulnerabilities and minor upgrades and, and, and things like that. But we also have product devolution. These are things where products are evolving and moving on us and, you know, we need to embrace those evolutions and invest in them. And then we have consulting that we do outwardly for the adoption of our products. Uh, and then last but not least, we do product startup.

00:24:13

You know, we might find ourselves in a situation where there's actually a new product that we want to start up, uh, and offer out there that we want to unitize it and charge for in our infrastructure. So this is kind of how we think about our product stack and what their unit cost is made up of. We envisioned what it meant to drive empathy, what it meant to drive feedback loops. And we kind of came up with a three loop model that said we we'd like to have feedback and empathy across our products. So if we're managing 44 defined detailed products of infrastructure, we want to know how do people feel about the collective set of products is something missing, uh, you know, how are we performing organizationally? Uh, we want to get feedback for the purpose of product evolution, like what is happening in a product as it's evolving, especially as it moves from on-prem to cloud native offerings and services.

00:25:11

Uh, so that's in the middle loop. And then at the moment of delivery, this is classic, you know, agile principles of product owner, sitting with the team and helping to groom backlog and making sure this product team is actually doing the right things, uh, and, and investing in the right things to make our consumers happy. And we ask each team to go out and start thinking about their product loops and figure out how do they get that perspective, which just so you know, one of the takeaways here today is like, what do we struggle with? That's still one of the things like infrastructure teams, like who acts as a product owner when you're delivering a product around, um, you know, compute or storage or an I series platform that multiple consumers use. And how do you get feedback on what's the right things to work on?

00:25:59

You know, in that product, one thing I had passion for was if we create feedback loops, how do we make sure that we respond appropriately? So nothing worse than a feedback loop feels like a meeting. And basically people go to a meeting and nothing happens. Uh, people feel like that you're unheard at that point. So how do you take and create continuous improvement from those feedback loops so that people feel heard and that you're baking those CIS into your backlogs and actually addressing them as part of your product orientation and your flow. So those things, we built these customer feedback frameworks for people to take an adopt, you know, not trying to be prescriptive, but trying to give frameworks so people can pull themselves forward. Then we get to, well, how are we going to help these teams transform? And, you know, we actually got to this transformation approach that says, you know, we need, these are the things that help guide product model support.

00:26:58

So I talked a lot about facilitated trainings. We still offered some agile learnings because we had some teams that were still coming forward on what, you know, what is agile in an infrastructure world? Uh, we still have, we had some infused dev ops training, uh, for, and we had a, what we call it a leader series to help leaders. Cause you know, the worst thing you can do is go have a bunch of training for your associates and leave leaders behind and help them understand, Hey, we want you to be the advocates for where we're heading. And we want our leaders, um, to, to be able to interact with our associates in gemba walks and help them understand the why behind the equation and help them understand how do we best, uh, move in this new world and how do we manage our work in this new world?

00:27:42

Uh, we had self-service re resources. So I'm a big believer in pull systems. So basically how do teams pull themselves forward and, and their practices. One of the greatest benefits that we see that we get from a product oriented mindset is being able to see the complete picture, being able to see what the cost of this product is, how we're either infusing new costs, how we're taking out costs and how we're driving unit cost efficiency. And I'll show you some examples, but until you start to look at it, you often can't make decisions about how to drive unit cost improvement and happy to say, one of the biggest outcomes we've achieved in this transformation is over $25 million of identified savings over the next couple of years, through product stack efficiency and analysis, and saying, Hey, we can make decisions about the tooling within our product stack, you know, about, um, the contracts within our product stack.

00:28:40

So I'll give you a couple examples of that, um, how that evolves. So, you know, here's an example. So storage as a product, you know, storage gets broken down into object, file block if you know, infrastructure, and it gets broken down into data protection storage and their key technologies. Um, these are the vendors we use. Don't get kind of anchored to that, but we say, so we go work with these vendors and say, Hey, you are a critical component of our stack and we want to optimize that stack and we want to leverage your capabilities, but we also want to optimize our spend. So, you know, how do we go through that analysis and work with our vendors and then ultimately drive out these opportunities. So you can see this stack over the next year. We see about a $1.1 million opportunity. Um, you know, as we analyzed everything from contracts, the, the hardware and software that we use and, and how do we bring in different components of the stack, uh, to manage that product.

00:29:35

Another example would be network as a product. So we treat network as a product that has, has separate product streams, uh, four of them and everything from, you know, our, our firewalls to our web gateways, you know, to our connected connectivity and our devices, uh, in our campuses and our data centers. And what does that stack look like? And what do we see in opportunities? Uh, not as much opportunity this year, but we do see some opportunity in firewall rule optimization that we can achieve, but that kind of analysis will be ongoing. Um, and then another one you have to take into consideration is we have a product, a container based product. So, um, rebate a transformation to rancher as part of this stack. Um, but this is a stack that you don't get a lot of savings out of because this product is in a high growth state.

00:30:27

So basically we're spending money now and we're growing the number of consumers as people move to a container-based platform to move to the cloud. So we expect actually, um, you know, more consumers of this product, uh, to help us drive down that unit cost versus driving down expense savings within the product. So an example of a growth oriented product that we have, I mentioned the outcomes that we were striving for, and one of those outcomes was, uh, customer empathy and feedback and making and delighting our customers and our unit costs and understanding what they're getting charged for. So our history has been, you know, we allocate our expenses out for many years and people don't know what they're paying for. You know, how much of this is mainframe versus how much of this is distributed technology and the products. So what I can say today is I think if you ask any of our CTOs, um, they are delighted by that transparency that we now bring in this model clearly knowing how many databases they're consuming and paying for in the services they get for those products, how many compute environments, uh, how much storage, uh, how much, um, MIPS they're using on the mainframe as we unitize that, uh, how many IDs they have in the mix and how they're consuming, uh, those ideas.

00:31:47

So I think that's a great outcome that we achieved in this model. The other one was delighting our associates and, and, uh, you know, these journeys are always tough. You know, some people move faster in the change curve than others, but if you just look through the lens of, um, our Gallup engagement scores, uh, we dramatically and raise those engagement scores over the last couple of years, we're now across just about all teams and infrastructure and operations, top core tile, Gallup's Gallup scores. Um, I hope that some of the product and organizational changes that we put in place have, are helping to drive that, um, because one of the key questions on raising associate engagement is I know what's expected of me, and I just firmly believe that if you know that you own a product and you know, that you're accountable for the plan, build, run your accountable to build it, ship it, run it, and make sure that you're delighting your customers.

00:32:46

You're naturally going to raise engagement. Uh, and I think that's happening. I'm not going to say it's all attributed to our product model and our lean agile dev ops journey, but I think it has something to do with it. I'm going to close, you know, uh, with really what obstacles still remain. And this is more of a question mark, where I could use all of your help. And a couple of those obstacles are, you know, clarity on product across the enterprise. So while we may have clarity inside of our infrastructure teams, how do we create those right intersections with other people in the software world, the business world, um, the consumer experience, customer experience world, as they think about their products. So we're still working on that as an enterprise team and, and how we can think about product definition and product taxonomy. Um, but, uh, it's still a remaining obstacle at the enterprise level.

00:33:40

Maybe not so much for our infrastructure teams, we're in the middle of a cloud transformation at the same time. So we live in a very hybrid world and kind of what is cloud going to bring in the orientation of product for us? Uh, how do we define those products as we make those migrations to the cloud, and how do product teams that traditionally have managed infrastructure, um, from an on-prem perspective, how do they think about that product orientation in the cloud? You know, does it even exist or do we have some responsibilities as a product team, uh, in the cloud at the end of the day, that's what I have to offer, um, in our journey. And hopefully that's an interesting infrastructure story and how we started to really think about the journey we need to take and infrastructure side-by-side with. What's been happening on the software development side of the house. So I think that is all I had. And, um, thank you very much.