"Foundation" models (Practical AI #172)
Changelog Master Feed
00:00
Transfer Learning and Scale
In terms of different levels of supervised learning and the fact that we are now more and more training models that are either unsupervised or at some level between that self-supervised. The thing that I am curious about here is how should I think about this in terms of transfer learning? Is this something that I would use as a base for transfer learning to build upon? Yeah, I think that when they're doing their report, two things are the two kind of pillars on which foundation models that they're calling them are built. If I'm remembering right, they talk about transfer learning and scale.
Transcript
Play full episode
