Last Week in AI cover image

Last Week in AI

#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

Apr 15, 2024
01:45:00
Snipd AI
This podcast covers AI music tools like Udio, TPU V5 accelerator, Mixtral 8x22B model, Google Gemma updates. Also, discusses Copilot's GPT-4 Turbo, OpenAI transcribing YouTube videos, Waymo's robotaxi service launch, and Mistral AI's surprise model release.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • AI music tools like Udio are emerging as the next ChatGPT for musicians.
  • Cloud TPU v5p by Google leads the AI accelerator race with powerful capabilities.

Deep dives

Efficient Transformer Models with Infinite Context

Google introduces a method to scale transformer models to infinitely long inputs using a compressive memory mechanism. By incorporating compressive memory into the attention mechanism, they enable both local attention over memory and long-term linear attention. Compared to alternative methods, they show improved performance in tasks like book summarization with 1 billion and 8 billion parameter models.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode