Las Vegas 2023
The HaCHAThon Story
The HaCHAThon Story
IK
Ivan Krnić
Director of Engineering, CROZ
Transcript
<silence>
So on this topic, uh, I'm gonna introduce the next speaker who is Yvonne Kerch, who is the director of Engineering at Crows. And he's spoken previously at DevOps Enterprise, which was of course great, but he blew me away by a, uh, lightning talk that he gave in Amsterdam about how he organized a hack day, uh, to level up everyone's understanding of gender, of ai, to learn what it is, uh, to gain at least some experience to inform an opinion on what's actually possible. It was such a cool talk. Uh, we invited him to give a longer talk, um, about what he did, why he did it, and where he took it from there. So here's Yvonne.
Thank you.
Thank you, Jean. Hello everybody. It's great to be here. My name is Kni and I'm here to inspire you to throw a company-wide generative AI hackathon. Uh, we had one at Cross and it was great, and I'm here to tell you why we did it, how we did it, and what have you learned from it. But before I take you on this journey, a bit about myself. So I am director of engineering at Cross, but here is my boss at home. So as you can see, she is not really practicing generative culture. I'm also running zero 800 Doubt podcast, and I'd like to thank all of my guests. Many of them are here in this room today. So thank you so much for this conversations. I had also the privilege to write a chapter for O'Reilly's, 97 Things Every Cloud Engineer Should Know.
Cross is a Creation and German BTech consultancy. We strive to help our clients every step of the way. So from ideation to operating services in production, an important part of this support is embracing new technology and helping our clients embrace new technology. Now, with everything that's going on lately in the technology space, this can sometimes feel like drinking from a fire hose. And with all the technology publicly available, I can't help but wonder, has technology stopped being a differentiator today? So admit, this is maybe too harsh to say, since many new business cases have been made possible today precisely because of the advances in the technology. Maybe a better way to put it would be that the real differentiator today is not the technology per se, but our capacity to navigate vast amount of new technology and embrace what is needed and what is needed. And we found out that a good way to navigate vast amount of technology is by using hackathons. And this year we did one around generative ai simply because every once in a while a new technology comes along with the capacity to change the world. And generative AI is definitely one of those technologies with generative ai. It's like when with any other technology, in the beginning, the uncertainty is super high and our confidence to use the technology is super low. But eventually these two lines cross, and this is where magic starts happening.
But for these two lines to cross, it's not of course enough just to sit and wait. We need to practice, we need to learn about the technology, we need to experiment with the technology. Only by practicing will we become true masters of the technology. And we found out that a great way to experiment with the technology is by using hackathons. Now, hackathons of course, shouldn't serve their own purpose. They should be part of a wider strategy. So this is the approach that worked for us. First, we defined strategic goals, meaning what do we want to achieve with generative ai? Then we threw an internal hackathon, gathered all the ideas, evaluated them, prioritized them, and finally we developed a roadmap on how to pursue these ideas. Further, I wanted to go a bit deeper into this step number two, what does it mean to throw an internal hackathon?
Well, for us, everything started with setting up an organization team, and they were later in charge for everything that was going on around hackathon. Uh, they did an introductory workshop. They set the date, they prepared all the logistics. They invited cross-functional teams to submit their ideas. They prepared cloud environments, created API keys. They even put some budget on them to, to keep things under control. And when everything was done, they made sure that teams documented everything in their Wiki pages based on everything that we learned. They defined new policies for using the technology, and we were good to go with new initiatives.
Now, when asking people to submit ideas for hackathon, there is always this dilemma. Should we give them full autonomy to submit any idea they want? Or do we want to retain full control over this ideation process and get precisely those ideas that we want? We knew from the beginning that, uh, open call for ideas without any guidelines would overwhelm people. So we gave them some guidelines. We asked them to think about two areas. How can generative AI help them be more efficient in everything they do every day? And the other areas, how can generative AI help them deliver more business value for our users? So in essence, we gave them enabling constraints so they can focus their ideas instead of spreading them around. We didn't ask for any upfront business plans or any business case justifications at this point. We just wanted to cast wide enough net to catch as many ideas as possible.
And there will be plenty of time later to evaluate these ideas and to talk business. This is how our event looked like. The energy was amazing, and there were even more people at the event than we have anticipated in terms of numbers. We had, uh, hundreds and 25 participants working in 36 teams across four geographically distributed offices. And after 70 something pizzas and after God knows how much beer, and you need to know that one of these offices was in Munich in Germany, and these guys really know their beer, uh, these teams came up with 36 ideas. Now we won't pursue all of these ideas, and I won't be talking about all of these ideas here, but I wanted to mention three of them just to spark a bit your imagination. So one team was working on CRM enrichment and predictions. So basically they took descriptions from Salesforce, opportunities, ran them through chat GPT and created a bunch of tags that were attached to the opportunity.
They also made this functionality for salespeople in motion so they can record voice notes. And these voice notes through whisper were transcribed the text notes, which were also appended to the opportunities. And these texts and metadata were regenerated. And once we had these enriched opportunities, we could do all sorts of things. So for example, we used Einstein AI to forecast, uh, the probability of closing the deal. We were also forecasting the deal size. And based on these tags, we generated a number of tag-based insights that were later used by CTO sales and HR to make everyday informed decisions in the company. So this was pretty neat need. Another team was working on AI support agent. So imagine how cool would it be if a person could pick up the phone and ask a question and then an AI support agent would respond in equally human voice. So our team tackled this problem from the middle. They fed FAQ database in check GPT and got some very promising results. And right now we are working on finalizing this end-to-end process with one telco in Croatia, including speech to text and text to speech part of this process.
The third idea is something that our marketing team was working on to make their life easier when submitting, uh, posts on social media. So they took one episode of zero hundred DevOps podcast. They transcribed it with whisper in the text, text, uh, form. They fed it into chat GPT to get a blog post summary. And they also fed it in the mid journey to get the visuals. And at that point, they had everything prepared for posting on social media. So the whole event was pretty neat. And couple of months later, we were invited by one of our clients, a large European bank group in Tessa Sao Paulo to facilitate their generative AI hackathon. And this one also turned well, it was even larger. So in terms of numbers, we had three group companies participating with 65 teams. Uh, they managed to organize everything in a single location, which was excellent, and we had 21 of our coaches helping with the event.
But what struck me the most with this is the number and the list of the departments that participated. So as you can see, this is basically the whole bank and the main stakeholder of the whole event was board member in charge for technology. So we had the highest possible level of sponsorship of this event. Now, the fact that the client organization, in this case in Tesa, Sao Paulo, invited a service organization in this case cross to facilitate their generative AI hackathon speaks volumes about the relationship or better said, partnership between client and service organizations. Much has been said here about this collaboration. Ben Grinnell led some amazing workshops that I participated in. And, and my favorite talk on this topic is from Courtney Kiler and Suzette Johnson from 2021. I think they managed to perfectly summarize this collaboration from client organization point of view. I always felt compelled to do something similar from service organization point of view, and I managed to distill my thoughts into a manifesto for sustainable service organizations.
So this manifesto has four values that I believe every service organization should live by. First two values deal with how service organizations should operate internally, but other two values deal with how service organizations should collaborate with the rest of the world. Now, this value number three, missionaries, our mercenaries is of course borrowed from Marty Kagan. And it describes the mindset and the attitude that service organization should bring to the table. Value number four, community over zero sum approach underlines that we should all collaborate in this IT landscape. This is not a zero sum game, and when the tide comes, it leaves all the boats. And today, looking in hindsight, I, I strongly feel that good results of Intestine San Paulo or hackathon were strongly influenced by us living by these values in this collaboration.
So what did we learn from this? From technical point of view, we learned you get what you give. So it's not a new radical song, it's just that the quality of generative AI results is proportional to the quality of of inputs. And one important thing that we learned six months now after the hackathon is that it is less about the specific AI technology that we use. It's more about integrating end-to-end this process in the organization, it's more about finding the right test data, it's more about anonymization, it's more about retraining. In other words, it's more about connecting organizational islands in a company. From organizational point of view, we learned that to evolve, we need to adapt, and that takes time. So we need to be patient. The change feels natural only if it's unanimous and organic. And that also takes time. So we again, need to be very patient. We also learn not to wait because by waiting, the uncertainty will definitely not drop and our competitors will only gain more advantage. And for this last one, I can almost personally guarantee whatever you do, you will be positively surprised with the results. In terms of help that I'm looking for, I would very much like to hear the ways in which you have jumped started AI generative AI initiatives in your organizations. And I would of course like to hear your thoughts and your ideas on how can we all together elevate this collaboration between client and service organizations.
Happy hatching everybody. Thank you.
Thank.