Design and Development Principles for LLMOps // Andy McMahon // #254

Design and Development Principles for LLMOps // MLOps Podcast #254 with Andy McMahon, Director - Principal AI Engineer at Barclays Bank.

A huge thank you to SAS for their generous support!

// Abstract

As we move from MLOps to LLMOps, we need to double down on some fundamental software engineering practices, as well as augment and add to these with some new techniques. In this case, let's talk about this!

// Bio

Andy is a Principal AI Engineer, working in the new AI Center of Excellence at Barclays Bank. Previously, he was Head of MLOps for NatWest Group, where he led their MLOps Center of Excellence and helped build out their MLOps platform and processes across the bank. Andy is also the author of Machine Learning Engineering with Python, a hands-on technical book published by Packt.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related LinksAndy's book - https://packt.link/w3JKL

Andy's Medium - https://medium.com/@andrewpmcmahon629

SAS: https://www.sas.com/en_us/home.html

SAS® Decision Builder: https://www.sas.com/en_us/offers/23q4/microsoft-fabric.html

Data Engineering for AI/ML Conference: https://home.mlops.community/home/events/dataengforai

Harnessing MLOps in Finance // Michelle Marie Conway // MLOps Podcast Coffee #174: https://youtu.be/nIEld_Q6L-0

The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses, by Eric Ries: https://www.amazon.co.jp/-/en/Eric-Ries/dp/0307887898

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Follow us on Twitter: @mlopscommunity

Sign up for the next meetup: https://go.mlops.community/register

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Andy on LinkedIn: https://www.linkedin.com/in/andrew-p-mcmahon/

Timestamps:

[00:00] Andy's preferred coffee

[00:09] Takeaways

[02:04] Andy's book is an Oxford curriculum

[06:13] Register for the Data Engineering for AI/ML Conference now!

[07:04] The Life Cycle of AI Executives Course

[09:55] MLOps as a term

[11:53] Tooling vs Process Culture

[15:01] Open source benefits

[17:15] End goal flexibility

[20:06] Hybrid Cloud Strategy Overview

[21:11] ROI for tool upgrades

[25:41] Long-term projects comparison

[29:02 - 30:48] SAS Ad

[30:49] AI and ML Integration

[35:40] Hybrid AI Integration Insights

[42:18] Tech trends vs Practicality

[44:39] Gen AI Tooling Debate

[51:57] Vanity metrics overview

[55:22] Tech business alignment strategy

[58:45] Aligning teams for ROI

[1:01:35] Communication mission effectively

[1:03:45] Enablement metrics

[1:06:38] Prioritizing use cases

[1:09:47] Wrap up