Lessons from a Successful Agile Adoption Outside of IT

This is the story of a multi-year agile adoption across an Internal Audit community of ninety people at Nationwide Building Society. What has been achieved is remarkable in the audit industry, at both a team and community level.


Regardless of your business sector, if you're interested in how agility can help outside of IT and thinking about improving agility, you will benefit from this session.


This from the trenches case study is packed with valuable lessons to share:


-What do we mean by business agility, in practical easy to understand language

-The benefits of being agile (outside of IT)

-The reasons for change and what measures to use to gauge how it's going (#BVSSH)

-How to approach a business agile transformation (outside of IT)

-What are the differences with IT, with practical examples of what works (and does not!)

-Why we started using the Scrum team-level framework and why we now have an bespoke iterative sprint based approach (scrum-like!)

-The role of the Agile Champion, and how to avoid the 'keep spending' agile coaching model

-What's possible with business agility, and the pitfalls and lessons.

ET

Eleanor Taylor

Agility Coach, Nationwide Building Society

Transcript

00:00:08

Hello everyone. My name is Ellie Taylor, and I'm an auditor and I've been an auditor for over 25 years in my career. So why am I here today?

00:00:24

Well, my recent, my most recent role at nationwide building society was as an audit senior manager, taking care of the transformation and it portfolio as part of that work, I interacted with lots of it and change teams. And I saw an increasing use of words and phrases that were relatively new to me at that time. This was about four years ago. People started talking about scrum and Kanban boards and sticky notes and ceremonies and all sorts of things that sounded really intriguing. So I decided to do some research and find out what it was all about and whether or not this was something that we should be looking at in internal audit and whether we should adopt those new ways of working. What I found really intrigued and excited me because I was absolutely clear that we could start to adopt and adapt some of those ways of working within internal audit. So today I'm here to share our lessons along the way, um, and how we went about adopting new ways of working with internal audit. What new ways of working mean to us and how they've benefited us and those key lessons that we keep close to us as we continue on our journey.

00:01:43

So before I go into any details about that, I think it's really important that we think about the internal audit context. And actually I think internal audit is really good. It's a good area for this sort of work. It's really, really fertile ground. So we have around 90 auditors and they are broadly aligned to business areas. The majority of them are located within and with the business in our swings and head office, or there were until very recently, we also have a few auditors, the task scattered around in some of our sub offices, uh, like Bournemouth and north Hampton. And we now have some in London. Our teams are typically small. They're around two to five people, probably no more than that. And the average lead time is start and end of an audit takes around 16 weeks. On average, we run a traditional hierarchy and we have a traditional hierarchy within internal audit.

00:02:41

So we have a chief internal auditor who sits at the top, who is supported by a senior leadership team who then oversee lots of audit teams that deliver those audits. And we run a standard linear methodology and by linear, I mean that we have a planning phase that's followed by another phase, which we call risk and control evaluation, which is then followed by some testing and it's then followed by some reporting and between each of those phases, um, there's a, there's a gateway so that, um, you can't proceed from one phase to the next phase without going through a gateway. That's how it was. Well, we do have an internal audit at nationwide is a bunch of hugely enthusiastic and highly motivated people who are willing to have a go at all sorts of things and try stuff out, try new stuff. And that really can't be underestimated. And it's been critical to the success that we've achieved within our function. So it's taken two years, probably two and a half years, but most of our audits are now using agility and different ways of working in some way, some of them to a larger extent than others, but that depends on their individual context.

00:04:02

Before I go into any details about again, before I go into any details, I just wanted to just share with you some testimonials from our auditees some feedback that we received along the way, these are really important because they show that we haven't tried to do this in isolation. And we've really thought about how this impacts on our auditees because at the end of the day, what we want to do is deliver valuable audits to our auditees. If we can't manage that, then we are, we are not going to achieve what we need to achieve. So if I start with the first one and that's from our chief executive officer, Joe Ghana, and he, he came along and visited us and saw all of our whiteboards in the office. And he also spent some time at a daily stand-up, which was a bit unnerving for the teams at the time, but it was great because what he saw was really good collaboration between the audit teams and the business and how effective that interaction can be.

00:04:59

Um, even on a, on a short amount of time, the next one really shows, um, for me, how we've achieved something that many audit functions have tried for years to achieve and, um, sometimes manage it, but not consistently manage it. And that's no surprises. So we all have cha charters in our internal audit functions that say no surprises in most of the places that we've worked. That's really, really hard, the adoption of new ways of working as allowed us to make that to consistent reality. And that's seen in this feedback and then the last two bits of feedback really, or where the start-off, what we now have as a huge library of feedback. And that demonstrates the value that we bring to our teams, the positive engagement, how engaged in it is how the business now understand what it is that we do, because we allow them to see what we do and we work with them.

00:06:02

Um, and the final, uh, the final sentence on this slide is probably one of my favorite sentences of feedback that I've ever received or the teams have ever received. And that is, I am a great fan of the agile audit. Imagine that as an auditor, somebody saying, they're a great fan of your work. It's absolutely transformational. So if I move on to, so how did we do it? Well, context is the thing. So throughout all of this, it's all about thinking about what is the internal audit context? How is that different? What are the things that are right for internal audit that may not be right for it and that world, but actually in order to it works. The first thing we looked at when we were looking at how we were going to do this was what are our reasons for change? So what, what is it that we, uh, what, why are we doing this?

00:07:02

What is our why? Um, and on reflection when I stepped back from this, um, I think those whys are probably very similar to organizational wide wise. So we're looking to be more forward-looking and responsive in an ever changing world. And when we first embarked upon this little, did we know how ever changing and volatile, um, and, um, and usual the world would now be, and by allowing us to move, to be able to adapt to that ever changing world that would allow us to continuously provide audit's of the highest value and continue to do that rather than setting a plan at the beginning of the year, and then just plowing our way through some audits and hoping that some of them will be valuable. We now flex our audit throughout the year to make sure that they're the right ones. And that helps us to grow internal Audix, um, relevance as a function.

00:07:59

So if we don't adapt and we don't provide audit, solve the highest value, that means that the work that we do and that the organization pays for becomes less relevant. It's not important. Um, and that's not a nice place to be. And I saw this as a wider opportunity to reinvigorate the wider profession. So the internal audit profession provides a great deal of value to organizations. And I saw this as a way to really showcase what value we can bring the quality of the work that we do, the expertise that we bring to the organization, um, and those that second pair of eyes to just challenge, but also supports the audit, the wider organization as they start to build and grow. I was also conscious that it would be really nice to be able to be sat around a table with, um, some, some people outside of work.

00:08:54

And when they ask what it is I do as an, as a job that I would feel quite proud to say, I'm an internal auditor. Whereas at the start of this, I felt that people sources secretive and, um, would write down anything that you said. Um, and weren't really that trustworthy. And I wanted to bring that out into the open and bring a level of transparency that would, um, enable people to feel really proud of their profession and also for the wider business to see the value that we bring and also to improve efficiency. And that was an interesting word at the beginning of all of this. I now tend to look at it as improving flow and pace rather than using the word efficiency, which seems quite, um, blunt. Really, it is, it has delivered efficient, better efficiency, but it's because we've moved to better flow and we've, we've improved the pace of our work. So those, that was the why.

00:09:56

So then we looked to what values were important to us. So what are the values and principles that we would want to, um, to stick to while we were doing this, this work to make sure that we were making the most out of, um, move into new ways of working. We started with looking at the agile manifesto when we looked at the wording in the agile manifesto, which is for software development, and sometimes that's missed out of the title. It is very IT-based, it was written for the it world. So that's not a great surprise when you look at the way that some of those values are articulated and the principles articulated, they are quite strongly. It, that's not that they don't work for us is just the way that they're articulated. We did go through a period where we thought we might just try and adapt them.

00:10:44

And then we thought, well, actually, why can't we just create some, um, values and principles that are our own and that we really want to stick to and all the things that we want to stick to, and this is what we came up with. So we still want to, it's really important to us fundamental to us that we deliver valued ordinance. And in terms of those new ways of working, those would be underpinned by the principles of continuous collaboration, continuous prioritization, and longer lived teams, and feel for those of you. Who've probably seen long lived teams before we deliberately change that to longer live teams. Because when we shared this with our auditors', there were some that felt that they didn't really want to be in a team for 18 months. They wanted really, to the thing that they enjoyed about their job of audit was that they moved around the organization and that helped them to build a P a wider picture of the organization. So now we try to keep our teams together for a longer period. So around six to eight months, um, so that's why we use the term and longer lived teams. So those are the values and the principles that we try to adhere to. So when we make changes, those are the things that we come back to to make sure that if we are making changes, can we still hold ourselves to,

00:12:06

In terms of our vision, again, looking at delivering valued orders. So that's our, that's our vision. We want to deliver valued dates and that's underpinned by some things that, um, that really explains that vision and that's efficient delivery, valued audits and engaged teams, and all of those three things together, focus on the, um, the work that we do from an efficient delivery perspective, the valued road from our customers, our auditees. So how do they feel about the audits that we're delivering and then our team or our people, our teams themselves I'll be happy. Are they engaged in the work to make sure that we are moving closer to our vision? We've set ourselves some metrics for each of those to make sure that we continue to be quite balanced, because if we focus on efficiency and, uh, we th that means that our, uh, valuable audits might drop the quality of our audits might drop. If we focus on value, it may mean that's actually our efficient delivery job drops. And if we just focus on efficient delivery and value, valuable audits, that might not be so great for our auditor's because we may be killing them by working them too hard. So we still want to make sure that our teams are engaged and motivated, and they're working at a sustainable pace.

00:13:24

So the metrics that we've chosen for those are lead time for efficient delivery. And that's the beginning to the end of an audit post audit feedback for valued audit. So at the end of each audit, we ask our oddities, uh, did you find that audit valuable, really simple question? Yes or no. And then for engaged teams, we run a net promoter score on a quarterly basis. So we find, we ask a question of, would you recommend internal audit as a place to work for, um, your colleagues and friends, and we use each of those things and we monitor them to see whether or not we're moving towards, um, our vision

00:14:08

In terms of those benefits and the metrics. So some of the results of that, I just wanted to share with you just to show how positive this has been for us. So from an efficient delivery perspective, we've reduced our lead time from 16 weeks to 12 weeks. And we do over a hundred audits over the course of the year. So that translates to quite a lot of extra audits that we can do, which I'm sure you will imagine the business are absolutely delighted about, but that just means that we can provide more assurance and more value to the organization in terms of those valuable audits, 100% of our auditees now consider our audit's valuable and that's a brilliant place to be. Um, and it, it, it makes me feel really good about my profession when I see that, um, and the rest of the team,

00:14:58

And then our engaged teams, uh, we run a net promoter score, which is currently running at about 12, which is positive. So we, there's still some room for improvement, but it's a good place to be. Interestingly from that school, we have seen peaks and troughs in that score. And initially when we started running it, it was running quite high, which, um, was exciting and disappointing at the same time, because I thought, oh, there's no reference to go because everyone's really happy. But actually over the course of the next few quarters, the NPS score dipped. And initially I thought that was because we were moving to new ways of working, but it quickly became apparent that that was largely because people felt safer to share how they really felt about things. Um, and we included, um, some open narrative at the bottom that allowed people to feed back why they had scored that. And that gave us great insight into where we needed to focus so that we could address that. And then we could start to lift that NPS score. And as you can see, that NPS score is now starting to move up again,

00:16:06

One of the added bonuses, and we have, we didn't put a metric on this. I wish we had now. I'm not sure what it would be, but, um, was that we now have a better understanding of the way that the rest of the business are moving to work. And that means that we can both support and challenge the business as they start to adopt new ways of working on a, on a bigger scale.

00:16:30

So in terms of changing our ways of working, um, we, we spent, we spent quite a bit of time trying to work through how we were going to change our ways of working. So there's lots of options. Um, so when we looked at our context, we really looked at the flow of work. So most of our work is, um, is complex. So when you look at it, uh, we don't know the answer. So we do some work and we might need to do some testing. And as a result of that testing, that then determines what we do next. Um, so if that pops it into the complex, um, area that, and there's some that is complicated. So we might, we, we might not need to do quite so much testing. And the results of that testing might not change where we go, but it's mostly in the complex space.

00:17:18

And when we look through the connecting model, we look through the lens of that, that complex space is where agility and scrum really sits. And we deliver, um, our work using teams. And that really made scrum an obvious choice. So it's a framework to build high performing teams. So who wouldn't want to build a high-performing team. Um, it has an enforced, inspect and adapt loop, which means that, uh, when we do our testing, we have a pause. We reflect on our findings and that determines what we do next. We use Kanban boards to visualize our workflow, and that helps us to then collaborate and communicate both within the team and act with the team when we talk with our stakeholders and oddities. So we started with scrum, um, and it was an experiment at the time. We didn't know how it was going to work, but actually it's, it's a really good fit for our team.

00:18:10

So whilst scrum is a really good fit for our teams, some things are helpful and some are not so helpful. So I just thought I'd run through some of those in terms of what was helpful. The three roles of the four events are, um, seeing us very helpful. They provide us with a framework and an understanding of what the expectations of individuals and the expectations and outputs that we expect from, um, and outcomes that we expect from those events. Not all of those events were viewed as useful at the beginning. Um, some were seen as, um, additional things that we might not want to do like the retrospective. Why would you want to do that every two weeks? But the more that we've coached our teams, the more that they can see the value that those Springs they bring. And I think it's fair to say now that all four events are seen as really, really helpful for our teams in terms of sizing, sizing has really helped us.

00:19:00

That's something that we didn't use to do. We now break our work down to D a day or a day and a half on each ticket. That's been really, really helpful in enabling us to identify where there are blockers and where work isn't flowing anymore. Um, and that's something that we didn't use to do. And that's been really helpful for us. Planning has been really good because what it's done it's helped us to do is to bring work forward rather than, um, happily going along and then having a hockey stick of activity at the end of an audit when the, when the deadline is approaching, we now break that work down and bring work forward. Um, and that just means that, uh, we are able to predict the outcomes a bit better, but happy path planning is very tricky with auditor. So that's something that we're mindful of, or just as like to build in a bit of contingency.

00:19:54

Um, so when were working with those teams and when we're coaching those teams, um, we try to make sure that there's no contingency built in because then we can't see where the blockers are. Visualization has been great from the perspective of the teams and also with the business, so that transparency helps both of them. Um, so it helps, um, to see the flow of work. It helps the business to understand what the work is that we're doing, where we're currently focused, um, so that they have a better understanding of what it is we're trying to achieve. And as a result, sometimes it can help, um, prevent us from, um, exploring areas that really have no relevance, which is something that we used to do quite a lot of before. Um, before the last few months, electronic whiteboards were seen as a last resort, but actually we did start to use them.

00:20:45

And for some of our teams that are not based in Swindon, their preferences and electronic whiteboard, I'm really glad that we did that now in retrospect, because actually that's been really helpful to help us to continue to work in this way. If we didn't have electronic whiteboards, it would make our lives a bit harder at the moment. And we'd have to be learning lots of new skills. And those whiteboards have helped us when we were physically in the building to co-located with the business. And that's something we've been trying to achieve the business for years, but now they can see the work that we're doing. There's the transparency of the work on the white board. They're happy for us to sit with them, whereas before they may well have felt that, uh, we were listening to every single word and they weren't really, we weren't really clear what it was we were after. So now they allow us to sit with them, which is lovely.

00:21:35

Um, in terms of the things that are not helpful in audit, um, I'm not going to labor any of these, but some of the jargon doesn't really sit too well. So I'm really conscious of some of the language that we use, um, within that, um, just common upon in, um, in the it world when they use Instagram. But some of that word, those words don't really work well within. I audit. So things like ceremonies, user stories, t-shirt sizing, planning, poker, those things, some of those things, we don't even need an audit because it's a different context. And some of those words are just not appropriate for the world of audit. We don't need full time, scrum masters in our audits. Um, and the teams can't just sustain it. We can't afford it. Um, and so we have trained our auditors who have volunteered to be scrambled, um, scrum masters, we've trained them and we coach them to be the best scrum masters that they can be.

00:22:31

Um, and they're really, really good at it and they love it. It can be, um, a bit awkward sometimes when, um, you have to then take your scrum master hat off and move to being a member of the team again. Um, but they are getting more and more used to doing that and mature in the way that they work in that way. Um, our audit teams are cross functional from an audit perspective. So they are made up of different specialists, um, with different functional specialisms from within the audit team, but we don't invite the business into those teams. So they're not truly cross-functional. And that's actually just to maintain our independence so that we can maintain adherence to the principles of internal audit. We'd get into a lot of trouble if we couldn't, um, uh, show how we are being independent from the business. So that's something that's, we, we have a bit of a red line on, and that's the same for our internal and external events.

00:23:26

So for the same reason, we don't invite them to our sprint planning meeting. Um, so we work out what it is we want to do. And then we talk with the business about how we can do that. Um, and similarly, we don't invite them to the sprint retrospective, our audit teams feel that during the audit, um, it's not appropriate to be out in the dirty lane in front of the business. And I, I really get that. Um, but what we do is we invite the business to retrospective at the end of the audit, um, to get their thoughts on what went well, what didn't go so well, what could we do differently? And we also give them that opportunity every two weeks in the sprint review. So we still get that information. We just get it in a slightly different way.

00:24:13

Okay. So I'm just gonna, um, finish up with the key lessons. So I'll run through some of the, um, the key lessons that we've learned through our journey. So if I start with number one, number one is all about context. So context is key. Um, we started with a framework that was built for it, and we needed to adapt that so that it worked properly in our context, in an audit context, one size doesn't fit all. Um, so even within the audit function itself, what works for one team might need to be tweaked for another team. Some of our teams are located in spending. Some of our teams are distributed across different sites. Um, so again, even within the, in the, in the, uh, function itself, actually the context is different between teams leadership, um, making it safe to try. So we had a re we had really, really good engagement and support from our chief internal auditor.

00:25:11

And she was so helpful. She was, um, really visibly and vocally supportive on a regular basis of what we were doing and where we were seeing successes. Um, she was really keen to share those both within the function and outside of the function. Um, but also when things didn't go so wrong, she made it really clear that that was okay because we learned something. So it didn't mean that it wasn't a failure. It was something to be learned from. And that's what that did then was to grow psychological safety. So then the teams were able to feel safe to try new stuff. Um, and that has been critical to the success that we've achieved. If we didn't have psychological safety, people wouldn't have tried new things. They wouldn't have felt safe enough to try stuff. Um, and that meant that we wouldn't have learned the lessons that we learned, particularly as quickly as we did.

00:26:06

It's all about evolution, not revolution. And when I say that, so we, we never once called this a transformation program. We never referred to it in that way, but it has been truly transformational. The results we've achieved are transformational. And when I talk about evolution, what I mean by that is we started small. So we started with one team. We saw how it would work with, um, um, at the end of that first quarter where we worked with that team, we took some time to reflect we to took a retrospective to say, okay, what worked, what didn't work? What do we need adapt when we start to take this to other teams? And then when we took that to other teams, we used, um, individuals from that original team to seed into the new teams, so that those new teams weren't starting from scratch, they already had the confidence of having somebody in their team that had tried this before. Um, so, and with that, that meant that we could, we could grow it.

00:27:07

So what about volunteers? So we've never imposed this on anyone and that first team self volunteered. We asked people to put their hands up and self-select who wanted to have a go at this first and who would be working in an area where the business were volunteers as well. And what's really interesting for me on a personal level is that I probably wouldn't have selected the team that first put their hands up for it. And that was a big learning for me, really early doors was that, um, if you've got enthusiasm, enthusiasm, take it because those volunteers will want to make it work. Um, and that was a really big lesson for me,

00:27:47

Treat everything as an experiment. So when we first started using the experiment, it probably wasn't, um, in as common usage across the rest of nationwide as it now is. Um, but we found that referring to things as experiments meant that our teams would have a go at stuff. Um, and that things weren't set in stone and that, because it was experimental, if it didn't work, it wasn't a failure, it was a learning and we could roll things back. It wasn't a pilot, it wasn't a test something out and then roll it out. It was, it really was an experiment. And that just that shift of language really, really helped us. So we treated everything that we did new as an experiment

00:28:29

Measure the metrics really, really matter, particularly, um, when we were looking at this, this is behavioral change. And inevitably at times when you're looking at some shift in behaviors that gets quite difficult. If you've got some data that shows that you're going in the right direction, that can help people to continue to face into some of the problems that you're seeing. Um, so identifying what measures or metrics you want really early means that you can build up that body of data. Um, so for us, for example, when people were finding it difficult, we pointed to the fact that our PAF scores or post audit feedback scores were, were increasing and were higher than they had ever been in the last few years. So our stakeholders and our auditees were really enjoying it. So why would we stop doing something that was obviously hitting the mark with our auditees? Um, maybe there was something else that we could do differently. So those metrics really helped us to continue on our journey

00:29:35

In terms of changing those behaviors. We found that changing the system is probably the quickest way to change those behaviors. If you ask people to change their mindset and change the way of thinking, they might want to do it. Um, but they're not really sure how to do it. If you change the system, you can help them to shift those behaviors. So for example, if I take that linear methodology, we had those gateways, um, we wanted people to move more freely between the phases of the audit, um, and sometimes do some testing, um, before they'd done some planning for some less prioritized work. Um, but while those gateways were in position, the auditors found it hard to move through different phases of the audit. Once we removed those gateways and we changed the system that meant that they felt more comfortable being able to be in a different phase of the audit, um, because it was a much more fluid approach,

00:30:38

Um, developed within. So it might need small and targeted investments in order to make a difference to this. Um, so in terms of that small and targeted investments, so I was, um, taken out of my day job as an auditor, and this was the focus of my work, um, for the whole time, um, and sitting alongside me, we had an agile coach, so we needed to spend a little bit of money to bring in that expertise. Um, but that it means that you retain focus on it. And, um, I still believe to this day that if we hadn't have done that we wouldn't have achieved, achieved as much as we did, because it would have been inside of the desk. So what the things would have come in as a priority. Um, and when things got difficult, we probably would have just not stuck at it.

00:31:24

So, so taking people out of their role and having, and using that targeted investment has been really helpful for us. And then above all, it's a means to an end, right? So what we are trying to achieve is better flow and increased value for your auditors and your oddities, um, happier teams for your auditor's. Um, so if something doesn't quite work for you, um, one of my key lessons is, well, let's see if we can do it in a slightly different way and adapt it. Um, not stick to something, if it doesn't work, understand what you lose as a result of doing something differently, but that doesn't mean that you have to stick to something slavishly. So I'm going to finish there. I believe we have a Q and a session next. So I'm really interested to hear your thoughts and, um, get your feedback and hopefully answer some questions that you may have. Thank you very much for your time today.