Is Scaling the Next Big Thing in Machine Learning?

There once was a time when AI researchers could expect to read every new paper published in the field on the arXiv, but today, that’s no longer the case. The recent explosion of research activity in AI has turned keeping up to date with new developments into a full-time job.

Fortunately, people like YouTuber, ML PhD and sunglasses enthusiast Yannic Kilcher make it their business to distill ML news and papers into a digestible form for mortals like you and me to consume. I highly recommend his channel to any TDS podcast listeners who are interested in ML research — it’s a fantastic resource, and literally the way I finally managed to understand the Attention is All You Need paper back in the day.

Yannic is joined me to talk about what he’s learned from years of following, reporting and doing AI research, including the trends, the challenges and the opportunities that he expects are going to shape the course of AI history in coming years.

--- 

Intro music:

➞ Artist: Ron Gelinas

➞ Track Title: Daybreak Chill Blend (original mix)

➞ Link to Track: https://youtu.be/d8Y2sKIgFWc

--- 

Chapters:

- 0:00 Intro

- 1:20 Yannic’s path into ML

- 7:25 Selecting ML news

- 11:45 AI ethics → political discourse

- 17:30 AI alignment

- 24:15 Malicious uses

- 32:10 Impacts on persona

- 39:50 Bringing in human thought

- 46:45 Math with big numbers

- 51:05 Metrics for generalization

- 58:05 The future of AI

- 1:02:58 Wrap-up