Changelog Master Feed cover image

ANTHOLOGY — Open source AI (Changelog Interviews #541)

Changelog Master Feed

00:00

The Evolution of Language Models

The PIL is now kind of the de facto standard for training large language models. We trained a 2.7 billion per owner model, which was a little bit bigger than G2B2 was at the time. 6 billion perimeters was the largest open source G2B3 style language model in the world. Since then, there's been a lot more investment and willingness to train and release models. Most interpretability right now is focused on final-existing artifacts.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app