Design and Development Principles for LLMOps // Andy McMahon // #254

17 snips

Aug 20, 2024

Andy McMahon, a Principal AI Engineer at Barclays Bank, shares his expertise on LLMOps principles, highlighting the essential shift from MLOps to managing large language models. He discusses the complexities of AI and machine learning operations, emphasizing automation and testing challenges. Andy reflects on the evolving tech landscape, stressing the importance of aligning technology with business goals and effective communication of ROI. He also notes the vital role of product managers in optimizing AI interactions to create real value for organizations.

Ask episode

Chapters

Transcript

Episode notes

Intro

00:00 • 3min

Navigating Machine Learning and Career Shifts

02:38 • 3min

Navigating the Life Cycle of AI Operations

05:58 • 4min

Navigating the MLOps Landscape

09:52 • 19min

Enhancing Decision Intelligence with SAS Decision Builder

29:01 • 3min

Navigating the MLOps Evolution

32:25 • 23min

Aligning Technology with Business Value

55:22 • 15min

Design and Development Principles for LLMOps // MLOps Podcast #254 with Andy McMahon, Director - Principal AI Engineer at Barclays Bank. A huge thank you to SAS for their generous support! // Abstract As we move from MLOps to LLMOps we need to double down on some fundamental software engineering practices, as well as augment and add to these with some new techniques. In this case, let's talk about this! // Bio Andy is a Principal AI Engineer, working in the new AI Center of Excellence at Barclays Bank. Previously he was Head of MLOps for NatWest Group, where he led their MLOps Centre of Excellence and helped build out their MLOps platform and processes across the bank. Andy is also the author of Machine Learning Engineering with Python, a hands-on technical book published by Packt. // MLOps Jobs board https://mlops.pallet.xyz/jobs // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links Andy's book - https://packt.link/w3JKL Andy's Medium - https://medium.com/@andrewpmcmahon629 SAS: https://www.sas.com/en_us/home.html SAS® Decision Builder: https://www.sas.com/en_us/offers/23q4/microsoft-fabric.html Data Engineering for AI/ML Conference: https://home.mlops.community/home/events/dataengforai Harnessing MLOps in Finance // Michelle Marie Conway // MLOps Podcast Coffee #174: https://youtu.be/nIEld_Q6L-0The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses book by Eric Ries: https://www.amazon.co.jp/-/en/Eric-Ries/dp/0307887898 --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Andy on LinkedIn: https://www.linkedin.com/in/andrew-p-mcmahon/

Timestamps: [00:00] Andy's preferred coffee [00:09] Takeaways [02:04] Andy's book as an Oxford curriculum [06:13] Register for the Data Engineering for AI/ML Conference now! [07:04] The Life Cycle of AI Executives Course [09:55] MLOps as a term [11:53] Tooling vs Process Culture [15:01] Open source benefits [17:15] End goal flexibility [20:06] Hybrid Cloud Strategy Overview [21:11] ROI for tool upgrades [25:41] Long-term projects comparison [29:02 - 30:48] SAS Ad [30:49] AI and ML Integration [35:40] Hybrid AI Integration Insights [42:18] Tech trends vs Practicality [44:39] Gen AI Tooling Debate [51:57] Vanity metrics overview [55:22] Tech business alignment strategy [58:45] Aligning teams for ROI [1:01:35] Communication mission effectively [1:03:45] Enablement metrics [1:06:38] Prioritizing use cases [1:09:47] Wrap up