The Inside View

5. Charlie Snell on DALL-E and CLIP

Sep 16, 2021
Ask episode
Chapters
Transcript
Episode notes
1
Introduction
00:00 • 4min
2
I'm a Movie Star. Is It Really Cool?
03:47 • 2min
3
Is Your Blog Helping You Write a Paper?
06:06 • 2min
4
Is There a Secret to AI Art?
08:19 • 3min
5
ML Research
10:54 • 2min
6
The Tricks of the Trade - Part Two
12:42 • 2min
7
The Most Simple Way to See Dali
14:44 • 2min
8
I'm Not Getting My Hands on a Dali Mini
16:20 • 2min
9
Dali
18:17 • 2min
10
Using Open AI to Design Your Own Shares
19:48 • 2min
11
How Do You Put Some Beautiful Avocado Share Into G Suite Codes?
22:12 • 2min
12
Is Dali So Good?
24:04 • 2min
13
How to Convert an Image to Codes in Dali
25:44 • 2min
14
Decoder
27:31 • 2min
15
VQVIE - Vector Quantized Variational Autoencoder
29:08 • 2min
16
Using VQVIE to Convert Continuous Vectors Into Distinctive Codes
30:45 • 2min
17
Code Book Vectors in VQVIE
32:18 • 2min
18
ML Trickery Isn't It?
33:51 • 2min
19
Code Book Vectors and a Vector Quantizing Hack
35:53 • 2min
20
How Does the Gumbell Softmax Approximation Work?
37:59 • 2min
21
Using a Code Book Vector to Sample a Code Book Vector
39:44 • 2min
22
Using the Gumbell Softmax Trick Is Like a T-Field Decoder
41:19 • 2min
23
Dolly's VQVAE Is a Very Good Technique
43:45 • 2min
24
Optimize the Image Given the Latent Vector
45:44 • 2min
25
The Best Intuition for the Right-Handed Term
47:48 • 2min
26
Dolly, Is It a Loss Function?
50:08 • 2min
27
Dolly
52:33 • 2min
28
Using a Transformer to Generate a Lot of Images?
54:29 • 2min
29
Is There a Degenerator in the DVAE?
56:20 • 2min
30
Scaling Loss in Language Models
58:00 • 2min
31
Is Scaling Going to Continue?
01:00:02 • 2min
32
Scaling Laws
01:01:40 • 2min
33
Scaling a Transformer
01:03:40 • 3min
34
Is There a Scaling Law for Symbolic AI?
01:06:34 • 3min
35
Isomorphism in Artificial Intelligence?
01:09:25 • 3min
36
Is There a Transition About Clip?
01:12:44 • 2min
37
Is There a Difference Between Traditional Labeling and Labeling?
01:14:47 • 2min
38
Open as Blog
01:16:49 • 2min
39
Creating Art for Clip and Understanding What's Going on on Twitter Timelines
01:18:49 • 2min
40
Generate Images With Clip
01:20:52 • 2min
41
The Image and Better Is a Transformer
01:22:50 • 2min
42
Big GAN - The First Real Clip Art Generator
01:24:34 • 2min
43
Lucid Ren Reproduces Every Single Transformer Based Architecture on the Internet
01:26:10 • 2min
44
What's Z Plus Quantize?
01:28:03 • 2min
45
VQGAN - Z Plus Quantize Trick
01:29:46 • 1min
46
The Z Quantize Trick
01:31:13 • 2min
47
The Yellow Smoke That Traps Its Muzzle
01:33:00 • 2min
48
Cleab's Generated Art Is Sort of Dysfunctional
01:35:05 • 2min
49
Machine Learning Interpretability Tool
01:37:33 • 2min
50
The VQ Cans Are Very Different From Deep Dream
01:39:26 • 2min
51
The Lecun Cake. Yeah. Yeah, Yeah.
01:41:21 • 4min
52
Unreal Engine Trick
01:45:07 • 2min
53
Are You Legally Licensed to Scrap Art Station Images?
01:46:48 • 2min
54
AK 9251 Training on Art Station
01:49:14 • 2min
55
Is the Map Painting a Good Prompt?
01:51:01 • 3min
56
What's the Best Prompt?
01:53:47 • 2min
57
Is James Gurney a Painter?
01:55:42 • 2min
58
AK Zero Points? Um, Yeah.
01:57:29 • 2min
59
Using VQ to Create a 3D Model
01:59:45 • 5min
60
Using the Emojis on AI?
02:04:23 • 3min
61
What's So Powerful About the Transformer?
02:07:07 • 3min
62
The Flamingo Standing on a Tree Branch
02:10:08 • 2min
63
How to Generate Noise Images Using Random Noise
02:11:44 • 2min
64
How to Denoise a Model?
02:13:17 • 2min
65
Using a Classifier to Generate Cat Images?
02:15:22 • 2min
66
How to Like De-Neuralize a Noise Generator?
02:17:01 • 2min
67
Using Clip to Generate Images From Noise
02:18:41 • 2min
68
Is There a Singularity?
02:20:46 • 2min
69
Is There a Prompt Engineer?
02:22:59 • 3min
70
What's Next for Artists?
02:25:53 • 3min
71
Are These Images Even Valuable?
02:29:11 • 2min
72
Recursion
02:30:55 • 3min
73
Do You Think Dolly Understands Physics?
02:33:31 • 2min
74
Is It Similar to Newton's Laws?
02:35:30 • 2min
75
Animated Clips
02:37:20 • 2min
76
Is There a Good Question?
02:39:12 • 2min
77
What's Your Favorite Piece of Art?
02:41:36 • 3min
78
How Much Would You Say to Increase Your Productivity From Using Code?
02:44:15 • 2min
79
Copilot
02:45:55 • 4min
80
Is Tesla Robotics a Good Idea?
02:49:49 • 4min