The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Multilingual LLMs and the Values Divide in AI with Sara Hooker - #651

Oct 16, 2023
Sara Hooker, Director at Cohere and head of Cohere For AI, dives into the fascinating world of multilingual language models and responsible AI. She discusses challenges in data quality, the Mixture of Experts technique, and the need for better collaboration between researchers and hardware architects. Sara highlights the emotional connection language models create in society, as well as safety concerns regarding universal AI models. The conversation emphasizes the importance of open science, inclusivity, and responsible practices in AI development for a harmonious future.
01:18:39

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Multilingual models face challenges with poor data quality and tokenization, relying on data augmentation and preference training for improvement.
  • The Mixture of Experts technique has disadvantages but can be motivated by factors like increased performance and flexibility in language models.

Deep dives

Cohere: Innovating Research Space and Collaboration

Cohere is a research lab that aims to create a new type of research space by combining traditional industry lab practices with open science initiatives. Their goal is to work at the frontier of language models and scaling infrastructure while fostering cross-institutional collaboration. With their unique approach, Cohere provides a platform for researchers from around the world to contribute and collaborate on AI research. Despite the unexpected challenges faced, such as the rapid interest in language models like GPT-3, Cohere continues to strive towards their mission of creating a meaningful and different type of research.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode