787: MLOps: The Job and The Key Tools, with Demetrios Brinkmann

MLOps, how to build an online community, and tools for scaling LLMs: In this episode, Demetrios Brinkmann speaks to Jon Krohn about the similarities and differences between LLMOps, MLOps and DevOps, and why this should matter to companies looking to hire such engineers. You will also hear how to get involved in the MLOps community wherever you are in the world, and how you can start developing great products with the available tools.

This episode is brought to you by AWS Inferentia (go.aws/3zWS0au) and AWS Trainium (go.aws/3ycV6K0). Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information.

In this episode you will learn:

• What MLOps is [03:51]

• About LLMOps [12:06]

• About LlamaIndex and Ollama [18:29]

• Insights from Demetrios’ MLOps survey [20:49]

• Guidance for using third-party APIs [40:18]

• Recommendations for building an online community in tech and AI [47:07]

Additional materials: www.superdatascience.com/787