(Voiceover) OLMo 2 and building effective teams for training language models

Nov 26, 2024

10:26

Full post:

OLMo 2 demo: https://playground.allenai.org/

OLMo 2 artifacts: https://huggingface.co/collections/allenai/olmo-2-674117b93ab84e98afc72edc

Chapters

00:00 Building AI Teams

06:35 OLMo 2

Figures

Fig 1, pretrain plot: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo2/pretrain.webp

Fig 2, pretrain table: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo2/pretrain-table.webp

Fig 3, post-train table: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo2/postrain-table.webp

Get full access to Interconnects at www.interconnects.ai/subscribe

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

Listen to all your favourite podcasts with AI-powered features

Listen to the best highlights from the podcasts you love and dive into the full episode

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

Listen to all your favourite podcasts with AI-powered features

Listen to the best highlights from the podcasts you love and dive into the full episode