This month, we chat with Amber Roberts, Senior Technical PMM from Arize AI. We met Amber this year at the Data Council conference, where we learned a lot about the concepts around LLM Observability during her great presentation. We wanted to dive a bit deeper on the podcast.

Amber chats with us about the foundational pillars of LLM observability including traces and spans and RAG/fine-tuning, the role of drift in LLMs, and how you can evaluate attributes like fairness and rudeness. Learn more about all the great projects and classes that Amber is leading and hear more about the Data Council conference.

Links:

Arize Community

Arize Phoenix HomePage

Phoenix Github

Generation AI Podcast Episode #8 Amber Roberts