3min chapter

Leveraging AI cover image

85 | GPT-4 is the dumbest model any of you will ever have to use! ChatGPT now has long term memory, and soon "search results, Anthropic has a "Teams" plan, Amazon releases Amazon Q for AWS, and more news for the week ending On May 4th

Leveraging AI

CHAPTER

Exploring Context Windows in Language Models and New Research Developments

The chapter delves into the limitations of small context windows in GPT models, comparing token capacity across various models like GPT-3, GPT-4 Turbo, Claude III, and Gemini Pro 1.5. It also introduces a new research paper on infinite context transformers and highlights the delivery of the DGX H 200 server for training language models by Jensen Hong to Open AI, drawing a historical parallel to a past delivery to Elon Musk.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode