3min chapter

Deep Papers cover image

Llama 2: Open Foundation and Fine-Tuned Chat Models

Deep Papers

CHAPTER

The Safety of Pre Training Models

Pre trained and fine to know lems, generally perform better than existing open source models. And then there's a number of measures they've taken to talk about the, the safety of these specific models. They go to a lot of detail about data gathering. One thing that I thought was really interesting was they go into a little bit about scrubbing PII but I also thought it was fascinating that they care to look at demographic representation in the pre training data.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode