Vanishing Gradients cover image

Episode 3: Language Tech For All

Vanishing Gradients

00:00

The Next Big Shift in the Language Community

The next big shift was from these completely wobas systems, wheether transformations and rolls written by hand by linguists. So a lot of corpus pate methods, things like amarkov models, hidn markov models came to the forefront. And then in 20 17, the transformer paper camet, which is a attention is all you need. The training time bottle necks aren't there any more. There has been a lot of work on treating large language models as dialogue models.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app