The Inside View cover image

5. Charlie Snell on DALL-E and CLIP

The Inside View

CHAPTER

Using the Gumbell Softmax Trick Is Like a T-Field Decoder

Using the gumbell softmax you get sort of this weighted sum of the original code book vectors that's supposed to represent a sample from that distribution. And at the end you can fit so the result the resulting vector from the T-field decoder will reconstruct the avocado share image from like all those like encodingsYou had all the yeah discrete encodings. Yeah what I'll just do is next diagram from the blog. This one is a lot of numbers basically it's this is just more like a detailed description of like this gumbellsoftmax trick.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner