Louis Castricato

Louis Castricato, a researcher at EleutherAI and founder of Synth Labs, dives deep into the fascinating world of RLHF. He explores the complexities of preference learning and the shift from PPO to DPO in reinforcement learning. The conversation highlights the challenges of biases in AI, especially regarding representation in training data. Castricato also shares insights on Gemini's impact on data safety, the evolution of model evaluation techniques, and the importance of collaborative efforts in advancing AI research.