The Gradient: Perspectives on AI

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science

23 snips
Feb 9, 2023
Ask episode
Chapters
Transcript
Episode notes
1
Introduction
00:00 • 2min
2
How Did You Get Into Machine Learning?
01:55 • 4min
3
The Post-Mom Machine
06:05 • 2min
4
How to Train Restricted Boltzmann Machines
08:32 • 4min
5
How to Train Restrictive Boltzmann Machines on M-Nist
12:16 • 3min
6
The Degeneracies in Large Scale Language Models
15:41 • 4min
7
Is There a Scientific Approach to Machine Learning?
19:30 • 5min
8
Are You a Dogmatic Scientist?
24:19 • 2min
9
Is There a Difference Between a PhD and an MSC?
26:14 • 3min
10
Is There a Detachment Between Machine Learning Algorithms and Science?
29:15 • 3min
11
How to Write a Ph.D.
32:18 • 2min
12
Do You Feel Insecure About Your PhD?
33:53 • 6min
13
I Love That Perspective Shift, Nia
39:30 • 6min
14
How Did You Overcome Your Insecurities About Machine Translation?
45:09 • 4min
15
Machine Translation - I Don't Know Anything About Machine Translation
49:16 • 5min
16
Scaling Up Machine Learning Research
53:46 • 3min
17
Is There Any Other Way to Scale Machine Translation?
56:24 • 5min
18
What Are the Major Ingredients of Transformers?
01:01:18 • 6min
19
The Transformer - It's Amazing!
01:06:57 • 2min
20
Is There a Way to Combine Ideas Together?
01:08:47 • 6min
21
The Distributional Semantic Model
01:14:40 • 1min
22
Scalability and Reason and Data Analysis - I'm Very Much Guilty
01:16:07 • 5min
23
Is There a Benchmark for Evaluating Models?
01:20:44 • 3min
24
How to Evaluate the Factuality of a Summarization System?
01:24:04 • 3min
25
Is There a Way to Predict the Model's Output?
01:27:16 • 2min
26
Pre-Trained Models - What Does It Do?
01:29:18 • 2min
27
Multitask Learning
01:31:26 • 5min
28
Is There a Destructive Interference Pattern in Multitask Learning?
01:36:34 • 2min
29
Do You Have Intuitions on the Neural Networks?
01:38:43 • 5min
30
Reading Millions of Tea Leaves
01:43:25 • 2min
31
Vision Language Navigation - What's Hard About It?
01:45:28 • 4min
32
The Distribution Shift in Machine Learning
01:49:05 • 4min
33
The Basics of Machine Learning - What Base Role Tells Us?
01:52:44 • 2min
34
Are We Really Seeing or Are These About Our Core Terms?
01:55:12 • 5min
35
What Are the Most Surprising Aspects of Chat GPT?
02:00:10 • 4min
36
Finding Balance as a Researcher
02:04:08 • 4min