

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science
23 snips Feb 9, 2023
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36
Introduction
00:00 • 2min
How Did You Get Into Machine Learning?
01:55 • 4min
The Post-Mom Machine
06:05 • 2min
How to Train Restricted Boltzmann Machines
08:32 • 4min
How to Train Restrictive Boltzmann Machines on M-Nist
12:16 • 3min
The Degeneracies in Large Scale Language Models
15:41 • 4min
Is There a Scientific Approach to Machine Learning?
19:30 • 5min
Are You a Dogmatic Scientist?
24:19 • 2min
Is There a Difference Between a PhD and an MSC?
26:14 • 3min
Is There a Detachment Between Machine Learning Algorithms and Science?
29:15 • 3min
How to Write a Ph.D.
32:18 • 2min
Do You Feel Insecure About Your PhD?
33:53 • 6min
I Love That Perspective Shift, Nia
39:30 • 6min
How Did You Overcome Your Insecurities About Machine Translation?
45:09 • 4min
Machine Translation - I Don't Know Anything About Machine Translation
49:16 • 5min
Scaling Up Machine Learning Research
53:46 • 3min
Is There Any Other Way to Scale Machine Translation?
56:24 • 5min
What Are the Major Ingredients of Transformers?
01:01:18 • 6min
The Transformer - It's Amazing!
01:06:57 • 2min
Is There a Way to Combine Ideas Together?
01:08:47 • 6min
The Distributional Semantic Model
01:14:40 • 1min
Scalability and Reason and Data Analysis - I'm Very Much Guilty
01:16:07 • 5min
Is There a Benchmark for Evaluating Models?
01:20:44 • 3min
How to Evaluate the Factuality of a Summarization System?
01:24:04 • 3min
Is There a Way to Predict the Model's Output?
01:27:16 • 2min
Pre-Trained Models - What Does It Do?
01:29:18 • 2min
Multitask Learning
01:31:26 • 5min
Is There a Destructive Interference Pattern in Multitask Learning?
01:36:34 • 2min
Do You Have Intuitions on the Neural Networks?
01:38:43 • 5min
Reading Millions of Tea Leaves
01:43:25 • 2min
Vision Language Navigation - What's Hard About It?
01:45:28 • 4min
The Distribution Shift in Machine Learning
01:49:05 • 4min
The Basics of Machine Learning - What Base Role Tells Us?
01:52:44 • 2min
Are We Really Seeing or Are These About Our Core Terms?
01:55:12 • 5min
What Are the Most Surprising Aspects of Chat GPT?
02:00:10 • 4min
Finding Balance as a Researcher
02:04:08 • 4min