AI Safety Fundamentals: Alignment cover image

On the Opportunities and Risks of Foundation Models

AI Safety Fundamentals: Alignment

CHAPTER

The Importance of Scalability in Deep Learning

Within deep learning, pre-training is the dominant approach to transfer learning. Transfer learning with annotated data sets has been common practice for at least a decade. In self-supervised learning, on the other hand, the pre-training task is derived automatically from unannotated data. The importance of the availability of data cannot be underestimated.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner