AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
ML Foundation Models - What Are They?
When I was doing my PhD at Stanford, most AI researchers were actually looking at selecting a bunch across a bunch of different models. But an important thing that happened around 2017, 2018, were these transformer architectures that came out. These just use the mechanism called attention and are really efficient to run on GPUs. They kind of took off and took over the landscapes and the ML community all collapsed in around 2018.