Josh Tobin from Gantry shares insights on improving ML-powered products, discussing vendor relationships, applying software engineering principles to ML, data observability challenges, and reflections on early business development. The conversation also touches on navigating attention and distractions in management.

Language model interpretability experts and AI researchers discuss challenges of evaluating large language models, the impact of chat GPT in the industry, evaluating model performance and data set quality, the use of large language models in machine learning, and tool sets, guardrails, and challenges in language models.