Chiara Caratelli

Chiara Caratelli, a data scientist at Prosus Group, emphasizes the critical nature of evaluations in AI development. She discusses the importance of stress-testing and building trust through rigorous evaluations rather than merely relying on larger models. Chiara shares her approach to bootstrapping evaluation sets and the role of user feedback in refining these tests. She also touches on the significance of simulating real-world interactions and the need for effective error analysis to enhance agent performance. Learn how her insights can impact the future of AI.

Paul van der Boor, VP AI at Prosus Group, and Chiara Caratelli, Data Scientist at Prosus Group, dive into the world of web agents—AI that interacts with the web like humans. They discuss why these agents are crucial in the evolution of AI, especially in improving e-commerce and automation. Challenges in creating agent-friendly web design are tackled, alongside visions of a future where booking flights or ordering food becomes seamless. Their insights into balancing prototyping with scalability offer a glimpse into the future of digital interaction.

Dmitri Jarnikov, Senior Director of Data Science at Prosus, shares insights on AI and Gen AI products. Chiara Caratelli, a data scientist at Prosus Group, discusses the dynamic blend of generic and specialized agents. Steven Vester, Head of Product at OLX, predicts that trust in specialized agents will grow before generic ones prevail. The trio explores the challenges e-commerce platforms face in integrating AI agents and emphasizes the importance of building trust for successful adoption. Exciting opportunities for new agent-driven business models emerge!