This Day in AI Podcast cover image

This Day in AI Podcast

EP51: OpenAI's Sora, Gemini Pro 1.5 10M Context, ChatGPT Memory, GraphRAG, ChatRTX, Microsoft UFO...

Feb 16, 2024
OpenAI's Sora, a system for generating 1 minute videos that track objects, is discussed, along with Google's Gemini 1.5. The potential of larger context windows in multi-modal inputs to replace RAG is explored. Microsoft's GraphRAG, which aims to improve RAG using knowledge graphs, is introduced. Nvidia's ChatRTX is tested on high-end graphics cards, and Microsoft UFO, an open-source project using vision AI, is mentioned. OpenAI's memory feature in ChatGPT is highlighted, as well as recent developments at OpenAI, including a researcher leaving and fundraising for chip development.
01:29:19

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Google's Gemini 1.5 offers a million-context window, enabling extensive data processing and positioning Google as a leader in AI development.
  • Microsoft's Graph RAG introduces a hierarchical structure of semantic clusters, improving contextual understanding and enabling more accurate answers.

Deep dives

Gemini 1.5: Faster and Cheaper with a Million Context Window

Google announced Gemini 1.5, a next-generation AI model that uses a mixture of experts approach. It offers a million-context window, with potential for even larger windows in the future. The model, built on the Pro version, provides faster and more cost-effective processing. With the ability to process large amounts of data, Gemini 1.5 enables tasks that require extensive context, such as finding specific moments in videos or answering questions over massive code bases. While the model's full potential is yet to be realized, this advancement positions Google as a leading player in AI development.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode