Deep Papers cover image

Llama 2: Open Foundation and Fine-Tuned Chat Models

Deep Papers

CHAPTER

The Safety of Pre Training Models

Pre trained and fine to know lems, generally perform better than existing open source models. And then there's a number of measures they've taken to talk about the, the safety of these specific models. They go to a lot of detail about data gathering. One thing that I thought was really interesting was they go into a little bit about scrubbing PII but I also thought it was fascinating that they care to look at demographic representation in the pre training data.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner