Flow Engineering – Learning to Lead from the Inside Out

The most important information system you'll ever manage is your own mind. The next most important is your team. If you can tackle these challenges, the computers will fall into line.


A world of accelerating change demands a new generation of management with the skills to drive decisive action and elevate performance. Managers tasked with delivering results collide with peers whose conflicting goals, perspectives, and incentives freeze progress and create a glacial pace of change. New thinking and practices are needed to act in alignment. You can't copy-and-paste a solution, and you can't do it alone. To collaborate effectively you need to create a shared map of the territory, and you need to pick your battles.


This talk presents profound yet practical applications of systems thinking, psychology, and organizational design. On that foundation we share a step-by-step guide to visualizing the outcomes, processes, and dependencies that can tie you down or help you succeed. Co-create maps of the hidden relations and interactions that constrain your teams - maps that everyone can align with and act on. Replace deadlocks with shared insights. Reveal exactly what to do next. Learn how to reach across the whitespace in your org chart to replace friction with flow.

AD

Andrew Davis

Sr. Director of Research and Innovation, Copado

SP

Steve Pereira

Founder, Visible

Transcript

00:00:12

Welcome to our session on flow engineering. We're going to be sharing a strategy for leading across the organization from the inside out. I'm Steve Herrera. I am the founder and CEO of visible value stream consulting.

00:00:26

I'm Andrew Davis. I'm the senior director of research and innovation at CoPortal. And we'd like to introduce you also to Sharon. Sharon is our fictional director of software engineering at bolt global. So I want to tell you a story. We want to tell you Sharon story and a story about working with Sharon to help her out. But, so the story is touching on three things, um, optimizing for clarity value and flow across an organization about how to use the technique of collaborative mapping to take what's inside our minds and put it out in a form that everybody can align around. And then through that, how to create win-win win situations for customers for the business and for the individual contributors. So Sharon's challenge, here's the scenario, her company bolt global is facing a lot of market pressure. Competitive pressure is pushing them to make operational efficiency improvements.

00:01:22

Also opening up new lines of business. They've launched a bunch of improvement initiatives, and that has in turn created a lot of work for Sharon's team that a massive backlog of changes that her team is tasked with delivering. So she's under pressure to figure out how to deliver twice as fast as she was able to do today. Um, you know, the question then is how so this, although it's a fictional scenario, Sharon is facing situations similar to lots of organizations around the world. Uh, and we know a lot of these massive it initiatives, digital transformation projects, and so forth end in failure. We look at the literature about why many of these initiatives struggled to get off the ground or struggled to succeed a lot of sources, point to an underlying lack of clarity. Either the leading founding teams fail to gain the clarity that they need, or they fail to share that clarity across the organization where they fail to sustain clarity.

00:02:22

As the competitive landscape is changing, and technology is evolving and so forth. So we're going to tell you about how to build clarity, but first focusing on why we struggled to find clarity. So think about Sharon situation, she's operating within the limits of her individual perceptual capacity. So she can pay attention to companies, strategic initiatives, her own initiatives that she's trying to roll out the work items that her team is working on the interpersonal dynamics and personal situations of people that are team it's a lot to balance, right? And she finds herself doing a lot of context switching through the day and struggling to keep everything straight in her own mind, just do the due to the limits of our human, mental capacity. As a species, we have learned how to create and enhance our clarity through culture, through interacting with other members of our community of our group, so that we don't necessarily have to know everything, but we can lean on the people around us, but cultural issues can also, uh, interfere with clarity, uh, power dynamics, presence, fear in an organization.

00:03:34

So it can impede people's ability to speak up and say what they actually honestly think about a situation and the organizations can end up being blindsided in dramatic ways when culture is not conducive to clarity. And that's particularly problematic today because the systems that we're working on, for example, Sharon's team is building something like 15 or 20 different applications. They all interact with each other in different ways. They're built on different technology stacks. The market landscape is changing. So there's a phenomenal amount of complexity that our team is trying to manage and she's trying to manage. And these three things together mean that it's legitimately hard to find clarity.

00:04:16

So what we want to share with you today is something of an underrated capability in organizations is, uh, these days, and, and it is collaborative mapping. It's bringing separate perspectives and individuals together to create a common understanding through mapping together. So by co-creating maps, by creating this canvas of separate perspectives, separate, uh, ideas and challenges, we're able to aid the improved performance of Sharon's team by getting all of the contributors, to bring their best ideas and their own perceptions to this common canvas that, uh, that creates this common understanding. So the practice here is highly engaging, right? We're bringing everybody and allowing them to speak up, to bring their strengths and capabilities to the team in a novel and fun, a way of collaborating. And the effect of this is that we create a shared context and a shared understanding. Um, but also allowing people to bring their perspectives means that they, they have a sense of ownership over the outcome.

00:05:34

You might recognize this as the Ikea effect. When you build something, you feel better about the end product. And by bringing everyone together, we're able to create a sense of alignment, almost convergence of these separate perspectives to a unified view of what's happening and what we can do with our capabilities and our situation. This is not a one size fits all approach. It's not a copy and paste that we know doesn't work. It's not a heavy framework or, you know, trying to adopt the practices of another company. We're creating something with Sharon's team, for Sharon's team in Sharon's situation. And while we're doing this, everyone is learning about flow. They're learning about how to improve performance by doing the mapping and revealing these opportunities, bottlenecks challenges, surfacing all of these things that often stay hidden behind the scenes. And one of the best aspects of this under the current circumstances is that it's very remote friendly.

00:06:39

We're able to include participants across Sharon's team who might reside in different locations, or, you know, they're only in the office a couple of days a week. So scheduling might be a nightmare if we didn't have something that was very remote friendly. So we're going to be guiding Sharon's team through a process that we call flow engineering, trying to optimize and improve flow. And we're going to be using three specific maps to do this. We're going to start by aligning every participant on Sharon's team, under a common understanding of what our target outcome is, what are we trying to achieve? So we know two times faster, but what does that really mean? And what is it going to take to get there? And secondly, what we're going to explore is what are the current constraints on what we're doing right now? Where are things challenging?

00:07:34

Where do things slow down? What is not working out about the work that we're doing right now? And we explore that a little bit in further detail by examining dependencies. What are the things that are, uh, slowing us down, perhaps inside the team or outside the team that we might be able to influence or mitigate starting off this process. We begin with the end in mind by breaking down that outcome of going twice as fast. So what does that mean? What are we going to have to do to get there? Starting from that point, we guide Sharon's team as facilitators through breaking down, what is twice as fast, actually look like. We want to make sure that, uh, we don't lose track of other important initiatives, like keeping the lights on. We don't, we don't want to pull too far in terms of, of velocity.

00:08:31

So that quality suffers. So it's important to the team to highlight. We want to make sure that we don't sacrifice quality as we go. The second piece about exploring this outcome is really forming a deep, common understanding about why this is valuable. Why should we ignore everything else that we could be doing in service of this, this one focused outcome and that kind of anchors the outcome and the team and makes it very real and tangible and powerful as a motivation for moving forward. The next thing that we want to explore as a contribution to the outcome is what are the things that are going to get in our way? What are those hidden Lego pieces that we're going to stumble upon in the middle of the night, as we're heading towards the fridge for our midnight snack? So looking at obstacles, the things that could hinder our progress gets all of our fears and challenges and things that we think are going to be troublesome out into the open so that we can form a strategy to avoid them.

00:09:34

And then we'll look at investigations. How can we learn more about the, the outcome that we're, we're heading towards? How can we learn more about what's going to help us avoid obstacles or get us to where we're going as quickly as possible. And finally, what we want to highlight are what are the measurements that are going to reveal a sense of progress that is going to show us that we're headed in the right direction. And so by building this map with Sharon's team, everybody's on the same page, there's this very strong and clear understanding of what it's going to take for us to get to our target outcome.

00:10:12

So this exercise opens up a clarity by bringing together points of view from within different members of the team and different concerns. One of the first things that this often exposes is that there's a lot of different goals and different values. Customers have varying sets of things they want. Business has varying sets of things. They want, employees have varying sets of things that they want. And so this is something that's always happening, but it's not always made explicit. So then once you surface these various, uh, potentially competing goals, you need to figure out which of these, if any, can you sacrifice and from one from among the goals and priorities that remain how best to balance these. So this speaks to there being three elements to any action. You'd like this framework. It's just a very simple way to think about things. Um, first of all, there's taking in information and beginning to make sense of perceiving and understanding.

00:11:10

So first thing that Sharon and our team does, they laid down the bits of information that they have. Um, but then second, there's a decision-making process always prior to an action, that decision making process is really a process of balancing various possible outcomes to determine what course to chart based on these competing goals. Only once you've made a decision. And again, a decision is a fundamentally emotional decisions. You take raw information and make an emotional call on what's most valuable. What's the best outcome. Then you can take action. Of course, the loop always continues once you've taken an action, you're getting feedback from the world. The thing things have changed, you're trying to reorient yourself to the next new reality, but these three always are in operation. But if you look at all three of them, they're on a, on a spectrum really from perceiving and understanding.

00:12:04

There's a spectrum from just raw confusion, which is where Sharon was originally starting out, um, when she was first tasked to make these improvements, which he wants to move to a state of clarity, right? So this is maximizing her ability to take in information and make sense of it in terms of decision-making the real risk is making the wrong decision, right? Uh, like the old adage that, uh, management is doing things right, leadership is doing the right things. So decision-making is a leadership choice about, are you making the right decision? Are you making a decision? That's going to take you in an effective direction? Are you actually going to be able to realize value from the activities to take on now action. When it comes to action, there's again, a spectrum here ranging from pure inefficiency, clumsiness, a lot of waste and friction to a state of flow. So these are the three, uh, three, these three aspects. They all have this continuum. We really want to optimize clarity value and flow throughout the entire organization.

00:13:07

So understanding a lot more about our outcome, creating a sense of clarity and shared ownership over that outcome has driven us to look at what are we doing right now that we can improve in order to get to that twice as fast. So we wanted to use value stream mapping in this case to discover a common bottleneck that we could focus on in order to improve the performance of the entire stream. So when we're mapping a value stream, where we start is by laying out all the activities involved that are contributing to our delivery of value, but we want to make this actionable. And so it takes measurement, right? We want to understand what is the difference between all of these actions, which one should we focus on? Where is the real constraint that should drive our decision-making? And so we, as we establish how long all of these activities take, we also highlight what are the delays between each activity, whether it's a handoff to a different department, or even from context, switching through individuals, and what this brings us to is by our ability to measure very simply we can identify a hotspot that is extremely valuable if we were to address it.

00:14:25

So we have environments set up here taking up 45% of the total time in the value stream, which means that if we tackle that, um, we're a good, uh, we're a good ways towards our twice as fast metric. And we can tackle that and then look elsewhere for other bottlenecks and constraints. So starting at environment set up, puts us into a good state for moving forward.

00:14:50

So what we're doing when we're looking at value stream mapping is we're focusing on collective flow, collective workflow taking for example, a sequence of tasks and seeing how can we minimize delays and minimize friction in terms of enabling the team to get work done and handle the handoffs collective flow opens the door to personal workflow or personal experience of flow. And this speaks to the psychological state of flow, which has been widely discussed since the eighties, um, which is a state in which the challenge that you're working on is a reasonable match for your skill level. So there's a, what's called a flow channel where the challenge and is a reasonable match for your skill and your skills naturally increase. And the challenges rise with them. And when you're in the flow channel, it naturally is conducive to an experience of joy. So this experience of joy is not just a luxury add on to the process of knowledge work. It's really critical to maximize engagement so that you're not facing a situation like, um, Gallup says we're only 35% of workers are really engaged in their jobs. You're reclaiming all of that surplus, mental energy and creativity from your team. And through that, you're naturally maximizing performance because you've created a situation that's conducive to your team in precinct, their skills systematically, uh, urged onwards by this experience of joy.

00:16:18

So now that we have clarified our outcome and revealed this very powerful and valuable constraint in the flow, we can dig a little bit deeper and we have to, because it turns out that environment setup is actually not entirely handled by Sharon's team. In fact, it's handled externally and Sharon's team doesn't actually have any control over that. They have to go elsewhere. And where they go to get environment changes is the infrastructure team. And this is one piece of the puzzle. Um, but among all of the dependencies that are affecting the flow, focusing here is really going to allow us to channel all the energy on the team towards this common goal. And once we get that out of the way, we can look elsewhere, but as a simplified starting point to clarify and, and focus our efforts, we are brought to the infrastructure team to try to alleviate this bottleneck.

00:17:18

So the infrastructure team is run by Kim as the director, and now the infrastructure team looks after all of the environments, both the development testing and the production environment. One of the characteristics is that they're always swamped. They've got tons of interruptions from production issues and notifications. You've got a lot of long running projects that they've been working on in some cases for years. And it's put Kim in a position of basically having to ignore any external requests she's at or above capacity. And so she's not really got any excess capacity mentally or time-wise to begin to think about Sharon and Sharon's concerns. So what we do is return to mapping to create a shared perspective.

00:18:04

So what we're aiming to do here is a second pass by including Kim as a first-class participant in the process, we don't want to create a bunch of BAPS and dump them on Kim and say, Hey, it turns out your, the problem, and we need you to, uh, to help us out, right. We're looking to include Kim in this process and make sure that she benefits just as much as Sharon's team. And the way that we do this is by recreating an outcome map between the two groups to find a common win-win scenario. And that brings us to a common value stream map. So what is the, the flow, uh, inside of environment set? So we're digging deeper to find out where's the bottleneck and environment set up now, uh, where can we influence the flow inside of Kim's team in order to increase her capacity? And, uh, likewise increase the capacity of Sharon's team to deliver value,

00:19:10

These issues of clarity, value, and flow. They become harder as you scale up. Uh, for example, introducing Kim and, uh, Sharon, uh, is introducing two very different perspectives. They both basically deal with totally different systems, totally different people, totally different concerns on a day-to-day basis. And as a result, they've also got different goals. So their values are not naturally aligned. Um, and just as you move through an organization through different zoom levels, uh, it's very hard for any individual to keep the whole picture in their mind. So for example, Sharon has a broad picture of what's going on in her team, but she may not know the details of particular projects that our developers are working on. And similarly with Kim, uh, not being able to understand the details of particular servers, and as you move up through executive levels of management, they may have a high level picture of what's going on in the organization, but lacking all the adequate detail on, uh, what's happening at a detailed level.

00:20:09

When we bring Sharon and Kim together, uh, often we encounter this issue of personality clash, and, uh, two people who may be, uh, hesitant or reluctant to get, uh, get along with one another. This is exacerbated by seeing these two people is kind of a, uh, opaque entity where you just see it as a person, but not realizing the psychology going on inside their minds in Sharon's mind. Of course, she's got a collection of perceptions and understandings, and they're built up over time, um, based on the, you know, her training and experiences, culture, and so forth. And that guides her decision-making based on what she values and guides our actions based on what seems to be the most effective way to accomplish this. And so she builds up a sense of self. You know, she has some sense that I, Sharon, this is how I see things is what I want.

00:21:02

This is what I do. She's built up this sense of self, really around these perceptions values and, uh, activities. Kim is the same. She's got her own set of information and, uh, framework structure that she uses to understand the world, her own goals and our own behaviors. And she's built her sense of self around those mental capabilities to a great degree. So what we're doing and focusing on through collaborative mapping is beginning to establish a shared view between these two, these two people, um, and by establishing a shared view, you open the door to establishing shared goals. You can begin to balance and prioritize competing values, and you open the door to shared activity, the ability to actually act together and work together further. You also open up the possibility of shared identity. So for example, on Kim's team, because they're dealing with very similar situations every day, they've got a very similar perception that have similar goals, similar activities.

00:22:00

And so Kim's team is very, very cohesive inside the team, but they regard other teams outside of them as other right, not, not their team. And so the self other dichotomy is, uh, exacerbated when, um, the self other dichotomy comes from who you see to be similar to you in terms of their views, their intentions and their activities. So it's aligning those views and tensions and activities creates a cohesion and a unification. So shared activity in particular creates shared identity from among various, uh, things that help to build a shared identity. And if you want to unify action, you need to unify people's minds, especially starting with a shared view.

00:22:45

So in the case of the broader organization, we're going to zoom out a little bit and sort of provide an overview of where we are so far. So we're in a situation where the organization needs to improve its capacity to deliver value, right? It wants to go faster, which means that Sharon's team needs to go fast, or it needs a capacity to improve performance. We also have then the need by identifying that bottleneck and Sharon's team, as Kim's, uh, environment set up, we need Sharon's team to, we need Kim's team rather to improve its capacity to deliver value. But of course, you know, we immediately encounter the situation where Kim's team is overworked. Um, where are they going to get this improved capacity from? And that's going to bring us to, uh, what we are aiming for with this, this collaborative mapping, uh, between the two groups of people.

00:23:42

So we're targeting environments set and looking at how we can bring Kim and Sharon together towards common, uh, improvement of performance by digging deeper into that. So what we do in that common value stream mapping exercise is dig a little bit deeper and find out, you know, we have several activities that are happening inside of environment set up, and we want to identify they're the bottleneck. We're digging deeper to find out what is the constraint that's going to move the needle the most, which brings us to a few separate areas. First of all, we discover that provisioning data tearing it down, refreshing. It takes up a massive amount of environment set up. So by refreshing the data only when it's needed, we're able to reduce the setup time by a significant percentage, brings us to the next bottleneck. And we can knock these off one at a time by minimizing manual testing.

00:24:45

We're able to drop, set up time by a higher percentage, but the reason we did it second, because it takes a little bit more work than just that data check. Finally, as we're getting into diminishing returns, we discovered that updating the environment itself re provisioning containers, um, also dropped the setup time by a significant percentage, but, you know, we sort of stopped there because we've hit, you know, a great return on investment for this exercise by digging deeper into these constraints. So as a result, um, what we discover is that we're able to reduce the total time, the lead time of, uh, Sharon's team's value stream by 35%, by tackling that environment set up and reducing the total time it takes to do environment setup. We've reduced the total time. It takes to do the entire value delivery process and increase that capacity for delivering faster. As a result Kim's team is going faster, uh, by improving its capacity Sharon's team is able to improve its capacity and go faster. And the organization is benefiting by improving its ability to deliver value at a higher level of performance.

00:26:05

So these elements of action, they're similar at every scale, which is one reason why we like this. Um, as an individual, Sharon has to go through this loop on an ongoing basis of perceiving, deciding, and acting. The teams have to operate in a similar fashion. And even at an organizational level, they're taking a massive amount of information, trying to make sense of it, making decisions and taking actions collectively. So when we look at the fastest way to build flow, you need to look at psychological alignment as your first step, helping disparate parties to build a shared view and doing it together, building it together as the most powerful way to get that joint ownership on the basis of shared view, you can begin to get shared goals. And from that shared activity, this kind of unification is created by building these maps together, especially. So if you look just in summary flow engineering, mapping your path to success, um, we've looked at outcome maps and how Sharon used these to clarify the goals that our team was trying to accomplish value stream maps, that she used to identify the exact challenge and limitation that her team was facing.

00:27:14

And then dependency maps, uh, that Sharon used to identify isolate the exact thing that was holding her team up, which ended up being outside of her team entirely, which is why we come back to bringing Kim in, to take a look at what are the shared outcomes that both Kim and Sharon can align to? What are they both trying to accomplish? How can we best mesh their individual perspectives beginning then to look at the aspects of the value stream that are shared by both Kim and Sharon looking at improvement opportunities that would also benefit Kim and her team, uh, enormously as well as Sharon. And so in summary, without com mapping, what we're doing is especially we're clarifying goals. There's a lot of different techniques that can be used frameworks and so forth for doing this. The real purpose is just getting that clarity and shared understanding, um, on the value stream mapping.

00:28:09

Again, there's many different approaches you can take, but your real goal is to identify the constraints in your process and then independency mapping. Your focus is how to address those constraints, understanding inside the value stream what's, uh, what's actually driving efficiency or impediments. So one thing we'd like to leave you with is emphasizing the power of building shared clarity as a foundation for collaboration. So Steve and I are working on a book with it, revolution that's due out next fall. So the books on succeeding with value stream management, by building clarity value in flow, we're delighted to have a chance to be sharing this as a summary of that material in advance. We can really use your help as well. We're looking for stories from your experience of where you've seen cross team dependencies work or lead the failures and difficulties. Um, we'd love to include any of that in the book, or just use that to inform our understanding we're available@inside-out.work. Uh, we have a newsletter, a bi-weekly newsletter as well as weekly office hours. We'd love to connect with you more and discuss, uh, what you're seeing in the world of work. Thank you so much.