687: Generative Deep Learning, with David Foster
Super Data Science: ML & AI Podcast with Jon Krohn
00:00
Writing a Book with Newborn Baby & Deep Learning with Transformers
The speaker shares their experience of balancing writing a book while taking care of a newborn baby, expressing their dedication of the book to their daughter. The conversation then shifts towards discussing Generative Pre-trained Transformers (GPT) and its importance in generative AI, exploring the role of attention mechanisms in transformer architectures. It further delves into the distinctions between different transformer models like GPT and BERT, emphasizing their applications in natural language understanding and sequence generation tasks.
Play episode from 01:08:49
Transcript
