4min chapter

Deep Papers cover image

Llama 2: Open Foundation and Fine-Tuned Chat Models

Deep Papers

CHAPTER

The Safety Benchmarks of Lama

The data set I don't know how detailed they went into the collection it was a lot of like it's open data publicly available scrubbed of sites that are known to contain PII and definitely not any of meds products. The discussion of the, the reward model that they built was fascinating because they built it over time and collected from a lot of human labelers. It speaks to the barrier of entry or the bar to entry if you wanted to get into training it's not just about having compute resources it's about having a large enough group of human beings to help align the model with the output that you want to get.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode