Importance of Running Experiments and Iterating Quickly in AI Systems

Hugo speaks with Jason Liu, an independent consultant who uses his expertise in recommendation systems to help fast-growing startups build out their RAG applications. He was previously at Meta and Stitch Fix is also the creator of Instructor, Flight, and an ML and data science educator.

They talk about how Jason approaches consulting companies across many industries, including construction and sales, in building production LLM apps, his playbook for getting ML and AI up and running to build and maintain such apps, and the future of tooling to do so.

They take an inverted thinking approach, envisaging all the failure modes that would result in building terrible AI systems, and then figure out how to avoid such pitfalls.

LINKS

• The livestream on YouTube
• Jason's website
• PyDdantic is all you need, Jason's Keynote at AI Engineer Summit, 2023
• How to build a terrible RAG system by Jason
• To express interest in Jason's Systematically improving RAG Applications course
• Vanishing Gradients on Twitter
• Hugo on Twitter

Upcoming Livestreams

• Good Riddance to Supervised Learning with Alan Nichol (CTO and co-founder, Rasa)
• Lessons from a Year of Building with LLMs