Las Vegas 2018

DevOps & Product Management: The Makings of a Beautiful Partnership

We are living in a turning point in the technology industry. It’s not just about delivering capability to market faster than your competitor (though that certainly helps!), but delivering customer value and business outcomes that drive intense customer loyalty and growth. The most optimized and scalable DevOps environment will be a highly prized gem for any business ONLY if the product management team is prioritizing the right capabilities into the DevOps process. This session will give you a peak into the works of technology product management, what they care about and how to influence their process to ensure DevOps runs smoothly at the front end.


Laura Fay leads the Technology-as-a- Service Product Management practice for TSIA, a research and advisory firm. Laura is technology industry veteran with over 30 years’ experience driving business growth from leadership roles in Product Management, General Management and Software Development. She has contributed to the growth of large well-established enterprises and a number of early stage high growth companies, including Good Technology (acquired by Blackberry), Sendia (acquired by Salesforce), Scalix (Founding Exec), ShareData (acquired by E*TRADE), cc:Mail (acquired by Lotus Development & then IBM) and Retix (co-founder. IPO). Laura holds a Bachelor’s degree in Computer Science (Hons.) from Trinity College Dublin and an MBA from Santa Clara University, California.


When not actively contributing to the technology industry and the product management leadership community, Laura loves to spend her time alpine hiking, cycling, reading historic novels and cooking with friends.

LF

Laura Fay

VP, Research & Advisory, XaaS Product Management, TSIA

Transcript

00:00:05

Thanks for being interested in the relationship between DevOps and product management. Um, my name is Laura Faye, and I am the VP of Research and Advisory at an organization called TSIA. Um, we're a small, um, research and advisory firm, um, largely focused on helping companies, um, transition to as a service and, and a very significant focus on the B2B space. Um, and our mission really is very focused on, uh, helping, um, companies really improve rev revenue and profit performance, right? By looking for those patterns of success, uh, to, from practices to, uh, to outcomes. And we're very, very heavily research based. Uh, we're global, and you may have seen some of the books that some of the principles of the company have put out. Anyone heard of complexity? Avalanche Consumption Economics, B four B, technology as a Service Playbook, one hand consistently up for all four <laugh>, you get the prize.

00:01:10

Um, and some of our customers are, um, as mentioned, we're the global footprint. So customers all over the world and some of the big technology vendors that you might expect. It is B2B Enterprise is really our focus. And my background is also, obviously in B2B enterprise software. I've worked for, um, three or three plus decades longer than I care to admit, perhaps in a number of startups. And some of the companies you see here who acquired some of the startups that I was with. And I cut my teeth in engineering in software development, uh, for the first 15 years or so of my career coming up to leadership there, and then spending, um, the rest of my career largely in leading product management organizations, um, and in the general management capacity. And so when Jean Kim asked me to, uh, speak at this event, he referred to me as the product management ambassador to the community.

00:02:07

And I thought that was very, that was very nice. Um, but so what I'm gonna talk to you about today is really the changing technology landscape and what it means for, um, what it means for, uh, uh, the technology providers and customers, um, product management's remit within that, and how that's dramatically changing and how I think the partnership of DevOps and product management can really, uh, make a, uh, a big difference if it's approached in the right way. And as always, with all of the presentations I understand here, I'll, uh, make an appeal for some of the help that I'm, I'm looking for. Um, can I ask the av can you move the mouse pointer off the middle of the slide? Thank you. Um, so I talk about SaaS technology as a service a lot, and I use the expression XASA lot, and people, I get the question regularly, you know, what is it?

00:03:06

Um, and I just wanna, you'll see it through some of my slides here. So I just want to put on the table that really, it's a catchall phrase, right? For anything that's offered as a service. And the industry generally is transitioning very significantly from traditional licensing models to offering technology on a subscription basis. So typically, XAAS is technology and services offered to the market on a subscription basis, or leveraging the technology to deliver a non-technical service, right? So healthcare industry, for example, is delivering, um, uh, traditional software, but as a service focused on value and, and outcome delivery. And obviously, all of this is enabled by cloud computing, which is why the DevOps relationship is so, so critical. And, and I'm obviously fueling the consumption economy.

00:03:57

Make sure I don't trip up here. Um, so the, you know, the, the world has been dramatically changing in B2B enterprise software, um, timer's not going Mr. AV timer, thank you. Um, things are evolving very significantly from selling, uh, when we say complex products to it, so many of you are in organizations that are also consuming and buying technology from B2B enterprise vendors, right? And traditionally it's been on what we call a perpetual license mode with a, you know, a 20 or 25% support contract. Um, and it's up to the IT department to go take that, um, software and, and, and get it up and running and, and, and make it all happen, right? So that's sort of traditionally where things have been and where things are are in process of moving to and dramatically going to is selling outcome services to business users. So budgets, and you guys probably see this, how many of you are in, um, it, it versus let's call it development core, okay?

00:05:09

And how many in what you would call core development handful. So it's about three quarters a quarter, okay? Um, so what we see in the marketplace is that budgets, have you seen budgets shifting to line of business? Yeah, a few nods, right? So vendors are generally starting to sell more to line of business. And when they sell to line of business, you know, it's not about features and functions. It's about what value can you deliver to me now, when am I gonna see the benefit of that value? Um, and, and what outcome, what business outcome am I gonna get, right? So the conversation dramatically shifts and, and for the customer, that removes a whole massive amount of complexity, right? But what's doing for the vendor is that vendor is taking complexity on board themselves, and they need to figure out how to deliver, uh, that service. And it's also, um, the result for suppliers is that unit prices are dropping quite significantly, right?

00:06:15

So for vendors, as software vendors in this enterprise, B2B enterprise marketplace have enjoyed very significant profits year over year, it's why the tech sector has been such, you know, such a, so attractive for, for Wall Street. Um, but in recent times, um, we see that product, product sold on a license basis, on a perpetual license basis to, uh, to their customers, has been dropping very significantly. Um, and the services revenue has been on the increase. Now, the TNS 50, that's an index that my company TSIA, um, uses to track the largest global top 50 technology and services, uh, companies on the planet. And as we've tracked that over the last, more than a decade, we see that that license revenue is really dropping dramatically service revenue on the increase. But you'll notice there's a gap, and the gap is really the source of, of the challenge.

00:07:14

And what you'll also see here, um, is in the red line, which shows the trend, right? Of that, um, soft, perpetual license revenue going down, which has typically been sold to it, feature function focused. The blue line shows that going up sold to not only line to it, but also to line of business and the value proposition very much shifting, right? And a genie is outta the bottle here. I mean, this, this crossover happened in terms of more revenue from services than from, uh, software licenses about five years ago, and it's fully anticipated to, to continue. Um, and so, you know, our estimates based on all of our measures is that about, about a quarter of the technology industry revenue today is coming from, uh, what we call technology as a service, subscription licenses to enterprise. And when you put that together with the other services that are typically sold, like support services, managed services, professional services, all in, you can see that that is really the majority, um, of the revenue.

00:08:20

So that's the revenue story. What's the profit story? And this is where, where we start to see some, some challenge right along the top here, right? You'll see traditional business, we'll call 'em legacy businesses that sell in the traditional manner I was describing, profitable, and you'll see as a service 2.0, which is also considered to be subscription based companies that are profitable, right? Amazon web services would be in this category. For example, Salesforce after 19 years, just turned a profit this year, and they're in that category barely. Um, and along the bottom, you see the unprofitable line of, as a service 1.0, we'll call those cloud native, born in the cloud. Es have tended to start there, right? Their business models aren't actually profitable, and they're all trying to figure out how to, um, get more profitable, um, in the cloud. And for legacy companies, we'll put people like, um, Autodesk, Microsoft, Oracle, a number of others who are navigating this, this journey, right?

00:09:28

Have first seen commoditization happening, um, and challenges with profitability. And then moving to, uh, offer subscription, uh, subscription models. So in this index I talked about where we track the 50 global technology and service companies, revenue flatlining to down and profitability 16%, that might seem okay, but not when you consider that the companies in this, in this class have typically been garnering 25, 30, 30 5% of operating income, right? And Wall Street Regar, uh, really rewards this category for profits. Now, you always wanna be skating to where the hockey puck is going, because in this case, where the hockey puck is, isn't very pretty. We also have another index we call the Cloud 40, which is the, the top, um, born in the cloud, 40, born in the cloud companies, a publicly traded, right? So we can analyze the financials and it tells an interesting story. We see the top line revenues been is very nice, profitability, not so pretty at all.

00:10:38

In fact, negative four you'll see has been improving, uh, as significant improvement from, from prior years. But Wall Street gives these companies like Salesforce, ServiceNow, um, um, HubSpot, many others like them, gives them a free pass on profitability while they're propping up the revenue side of things. And, and, but the question comes, what happens when profitability starts to slow down a little bit? We know that that spotlight's gonna move. So where is the technology industry on this grid that I just presented earlier? It may be comes a surprise to you to learn that a full 80% of companies are not operating on a, a profitable basis from a gap perspective, which is the accounting general accepted accounting practices. Um, and certainly 80% of the SaaS companies out there are not operating, um, on a, on a profit when it comes to, uh, as measured by SaaS. So, so this obviously creates some big challenges for the industry, but you'll see how this is affecting product management and then how it ultimately affects sort of the relationship and how DevOps can help. But really quickly, taking a look at this Cloud 40, this is the top, as I said, publicly traded, born in the cloud companies, and you'll see that the majority of them are not profitable. I mentioned Salesforce a while ago, 19-year-old company, barely turned a pro, just turned a profit this year. How many of you are surprised to hear that?

00:12:16

Maybe a third? Um, I used to get a lot more reaction when I'd say, did you know they're not profitable? Now I can say they're, at least this year, they're showing some profit Amazon web services reporting in the high twenties in operating, uh, uh, income. However, their p and l is very sort of buried within the broader Amazon, uh, p and l. And our estimate is that it's probably closer to 15%, still very good. Still very, very good by, by these comparison, but not, uh, typically traditionally where the technology industry, um, has been. But you see, uh, on the other side here, that negative 4.5 on average is five points better than it was last year. So it's moving in the right direction. But this is really creating a lot of significantly changing conditions, number of different revenue streams, different, um, uh, business models and KPIs to track, right? Recurring revenue, uh, product adoption, um, product. And we see product and service converging, right? So traditionally, product management was just all about the technology. Now it's gotta be more broader than just the technology, right? And we're seeing that low profitability, um, in the business model. So what, what impact is this having on product management, right? I'll just build this out, very significant, um, very significant impact.

00:13:43

It is impacting how they're bringing new products and services to market, right? If you're going to have something as a subscription and you're faced with the kind of profitability profile that I was just describing, you gotta figure out how to craft those offers in new ways so that you're continuing to unlock value and apply price points, um, in that as you go. How do you design products to keep, to really develop, uh, and deliver an immersive, um, experience for, uh, for your user base so that you're proactively driving, um, the outcome for them, right? Um, many companies have had traditionally, uh, on-prem software, now we're move, they're moving to the cloud and have to think about what the deployment models for that looks like. What are the architectures for that? How do you, how do you develop out things like microservices, many other, and many components that they may not have had to think about before?

00:14:40

Um, what are the go-to market methods? Well, the channel you may have had access to the market via channel, uh, channel distribution, um, that may not be viable anymore because of the, um, the economics telemetry and analytics is absolutely a huge, huge factor, uh, for B2B enterprises. It might surprise you to know that only 15%, 15% of companies are, have the right telemetry in their, uh, in their solutions to really track user behavior, um, customer lifecycle, and, and all of the key use cases, and even even lesser using leverage, even when they have the data available. Um, they're not really good at making it available across the organization. Release cadences are speeding up. I don't have to tell this audience that. Um, but product management has to adapt to that. And in fact, marketing and all of the other, um, support organizations have to adapt, um, to that.

00:15:46

Um, you know, one company was just talking to recently, so they used to do a big bang launch every six months. You know, they'd package up the whole series of features, put them out into the market and do a big, uh, a big, uh, marketing launch. And they were struggling with the idea of what do I, how do I market my products now if I'm pushing new stuff out to the market every day? And then the support organization in education services going, well, the customer's seeing some new content before we even see it, and have an opportunity to think about what that means for our training programs. So it's a, it's a massive, massive, um, uh, adjustment. And the cross and even org design, you know, uh, product management has the, maybe product managers who might be more outbound facing product owners that are facing into engineering and into DevOps.

00:16:41

What, what is the right, what are the right ratios now to keep everything in balance, right? Versus some of the traditional, um, uh, development methods and how do we engage cross organizationally to make everything a reality? And there's more and more, um, more and more of an emphasis point. This the statement, you know, that product management is the CEO of their product was always sort of somewhat of a cliche, but, you know, in, um, in as a service war, in the world of, as a service, um, it's becoming, uh, more and more true because ultimately, the in-market success of the solution, product managers just can't stop at launch, right? They have to kind of continue, um, to continue to ensure that the product has all of the right components to be ultimately growing market share and growing it profitably, right? So there's a new emphasis on, on profitability, typical scope of responsibility of product management, right?

00:17:43

So with what they do all day, they do figure out what their strategy go to market strategy is, what are the financials with the business plan for their product? Um, what markets are they gonna go after? What's the size of the opportunity in those markets? What's the offer market fit or product market fit, right? Um, uh, how do they monetize? How do you create a series of offerings and monetize, um, what you, what you can offer to, to, uh, to the market? You know, we've talked about, um, there's many, um, uh, books and, and, uh, thought leadership pieces out there about the, this concept of the software paradox, right? Where software's delivering more and more value, but ultimately it's harder and harder to make money, which puts a very significant pressure to product management to figure out how to create the right packages and solutions and how to prescriptively then drive the customer experience to consume those, and at a price point that's gonna help deliver profitability. And then ultimately, that closed loop of managing in, in market success, rap and, and rapidly, um, rapidly developing solutions and getting feedback, um, at every step along the way.

00:19:00

And because the, uh, imperative is, is so high for profitability, which hasn't really been there, as you've seen in some of the numbers, um, we're seeing an increasing number of product management organizations reporting directly to either business unit leaders or CEOs, right? Um, and in recognition, any of that sort of strategic importance, how many of you are in organizations where your, your product management organization reports centrally only? Just a handful. And so for most, is it reporting into the technology side of the house or into the marketing side of the house? Technology side of the house, okay. Marketing a little less. So more on the technology, uh, uh, a little less, um, on the, on the marketing side. Um, so this is some of the, within this, uh, within the enterprise software space, this is, this is what we're seeing, and to emphasize where product management really has their, um, uh, incentives, you know, their variable compensation traditionally has been around revenue, okay?

00:20:16

Grow the revenue for your product, grow the market share for your product, and make sure that you deliver those features on time. I mean, those are sort of some variation beyond that, but that's sort of the 80 percentile rule in terms of what, how they've been, um, compensated. But now there's that added component. Right? Now you've got to drive product adoption, you've got to drive recurring revenue growth, and product adoption is a very critical component of that recurring revenue growth. And we know that 80% of all revenue generation is gonna come from existing customers, right? Which is why that adoption, uh, why they're measured on product adoption and stickiness, and also now measured on profitability. So that puts big emphasis on many things. Like how do you, well, we'll see in a moment what that puts big emphasis on. So if we look at the profitable technology as a service formula for growth, it includes all of these, uh, all of these elements, and I'm not gonna go through all of them, but just to say that this, there's, there's a, a critical formula that is essential.

00:21:26

I mentioned offer, market fit, complete offer. You may have heard of whole offer. So there's the technology piece, but then there's also strategically just in time delivered services, or maybe other, um, uh, transaction services or in-app purchases or other Com components that complete a whole product with the emphasis on value and outcomes, designing pricing and related components that, um, that deliver on that are, um, an example. So an example of value based pricing. I'll take HubSpot as an example. So marketing platform, right? The objective of that marketing platform for the, for the user is how do I, uh, amass as many email contacts as I possibly can, right? It's a, so I'll be doing campaigns, I want to capture contact information. So HubSpot has a pricing model for their marketing platform based on the number of email cap emails captured. That's an example of a value, but it's something that the customer values.

00:22:30

The customer's gonna be driving to that. And the more they do that, the more value they're getting from the platform. And that's a, uh, that's a, that's an example. Um, but companies working very hard to figure out those things. product-led growth strategy, which is really all about prescriptively engineering the outcome for either the buyer's journey, combination of the buyer's journey and the customer journey, post-sale, tele customer experience, telemetry and analytics, and the course leveraging as much as possible automation and AI to drive scale into the business. So the things that keep product management up at night are really figuring out what is that long term combination, right? What is that strategy that's, that's in the face of an immense and increased competition in the marketplace? How to navigate the world of recurring revenue and new customer engagement models to really drive, drive revenue, knowing that exactly how the customer is going to engage along the way, figuring out that continuous delivery and, and operational scale and, and ultimately, whoops.

00:23:40

Yeah. And ultimately driving down cost. I didn't share a lot of the details on it, but one of the massive things that's completely outta whack and as a service businesses is marketing and sales cost. Um, for example, the average for SaaS companies that are over 500 million that have, you know, achieved a reasonable amount of scale, um, is, is about 36% of revenue. Um, that's high when you compare it with, um, traditional licensed companies that be spending maybe 25% of revenue on marketing and sales. Um, Salesforce spends, uh, about 45% of their revenue on marketing and sales, and that's down significantly from much higher numbers. Guess how much Splunk spends, guess how much Splunk spent on marketing and sales as a percentage of revenue in Q2 2018? Any guess?

00:24:33

5, 3 72.

00:24:39

Who said it actually said the number? Yeah, unbelievable, right? So that's an example of what's propping up that growth line is massive overspend on, uh, marketing and sales. And so that is very, this is where things like the buyer's journey, you know, product driven growth strategies to, uh, a product-led buyer's journey, a product-led customer journey, instrumenting the products to really understand the behaviors. And driving that at scale becomes absolutely critical to the viability of, um, as a service, uh, companies. Now getting to a little bit to product management and some of the characteristics there. So, you know, if you look at roadmap, prioritization, pro prioritizing the product roadmap, right? And, and delivering that prioritization, prioritized backlog, um, to, uh, development has always traditionally been a big challenge and remains a big challenge. Um, new, the added ones that are over on the, um, on the left here are, uh, new cross organizational handshakes and develop and, uh, accelerated release cadences, right?

00:25:49

That's something you wouldn't have seen before, but it start is really kind of rising in the, in the things that they're challenged with. And in companies quest to, uh, get the right alignments across organizations. Um, you know, we took a look at what are some of the typical alignments that under, under, you know, with, with product, uh, leadership. And interestingly, we saw that if you combine the terms r and d and engineering together, because some companies use them, interdependently, that's at 55%. That's really the biggest area where product management and and engineering really are aligned after that, it's, it's marketing as we were talking about, a little less on the DevOps side. Um, but we're seeing that for companies that less than a billion, which are more likely to be born in the cloud companies, we're seeing that alignment very, very, very, very close. Is this a surprise?

00:26:48

I see one, one shaking head, but, okay. Um, and this is the, this is the big one for that I'm just constantly blown away by, because it seems so obvious that full product instrumentation to capture the customer journey is really an immature practice today in B2B Enterprises. Now, some of that, I, you know, surprised some of this could be, uh, as a result of, um, uh, just legacy product having to retrofit, right? I'm gonna speed up here. Um, the other piece of this is that when products are interment instrumented to capture usage, organizations are not strong in providing accessibility to the data. So there's a lot of culture of that, um, there yet. And so really the challenge is how do we accelerate the time to that profitable revenue growth, right? We know the markets are move, have moved to what consumption models. We know, we've seen about a quarter of the revenue in the technology sector is moved to techno as a service subscription models, but we see through all of the, the data that the practices to align to delivering on that, um, are, are really lagging. So that kind of brings us to the DevOps and product management partnership, right?

00:28:08

So if we look at that and, and kind of talk ourselves through how can we work together to accelerate time to profitable revenue, if that's the question that's on the table, um, there's many, many things that, um, both constituencies can benefit very significantly from collaboration. So I know that DevOps always wants to understand, uh, how they can contribute better to the business. Um, and product management is desperately trying to understand things like, how can we instrument our products better? What are the best technologies to do that? Um, the technical, the technical community, um, can help with that very, very significantly. Establishing shared goals between those groups will be really become essential in order to drive that level of collaboration. And DevOps, in my conversations with many folks, um, have, have had many, um, thoughts about how they can improve, um, improve the product, improve the usability of the product, improve the telemetry of the product, improve many of the, the capabilities of the product as a matter of finding those partnerships, finding, um, even one-on-one champions to have those conversations with and to create, get the right leadership active and engaged in that.

00:29:38

And the other one that I think is an interesting, uh, conversation to have is if you look at from, you know, uh, the value stream from code to cloud, how do you expand that on both ends, right? How do you expand that from concept and idea all the way to customer use? So expanding it on both sides is really, um, a very, very significant and, um, motivator from a product management perspective. But obviously with DevOps in the middle, right? You, you've really got to collaborate on both of those ends around the customer experience and around the tooling to, to enable that.

00:30:23

And who better to help product management with topics of availability, reliability, and security. You know, I don't think in, in all of my own personal experience, um, except one company, um, there was anybody in product management who really understood, uh, they understood that they needed security, but the degree of which that really needed to come to bear was always the intelligence for that always came from, um, uh, the development organization and the, and the DevOps side of the equation. And that's a significant value. So there's no question that there's significant number of topics to talk about and to get aligned on and, and for a mutual benefit. And I would say, you know, in summary, right? There is a very profitable revenue growth, which is the thing that many of the technologies are, are, uh, ultimately really working very, very hard to figure out the relationship between product management and DevOps can play a very significant role, um, because we have this interdependency, right?

00:31:31

Um, DevOps can, can enable very significant rapid pro prototyping, which is really, really critical for the product organizations to be able to, um, to master and to be able to make a form choices of AB testing and, and, and other aspects. Um, uh, as they're testing the market with a number of things through increased responsiveness, um, and product ha product management with an agile approach can hopefully help the, the flow, the flow of work through delivering backlog and workloads to DevOps in a much more streamlined kind of a way, right? And making all of that visible end to end.

00:32:18

So finally, I think I'm out of time. The help that I'm looking for is, I would love to hear from you email, phone, any, any social media, um, channel that's appropriate and understanding how does, and even talking one-on-one, you know, case studies, how does the interface with your product management team aid or detract from your productivity within DevOps? How would you want it to be? And, and what are some of the examples that you're working with today? And if any of this has, has resonated in any way and can that relationship improve? So that's, thank you for your time, attention and listening today. And, uh.