

The AI Pioneer Developing New Kinds of Medicine
12 snips Jul 17, 2025
Jakob Uszkoreit, CEO and co-founder of Inceptive and co-author of the transformative paper on AI, discusses the groundbreaking role that transformer models play in modern technology. He dives into how these models revolutionize language processing and explores their application in predicting protein structures. Jakob highlights the potential of AI in developing new RNA-based medical therapies, particularly inspired by the efficacy of mRNA vaccines during the COVID pandemic. His insights on the future of medicine showcase an exciting intersection of AI and healthcare.
AI Snips
Chapters
Books
Transcript
Episode notes
Transformers Power AI Breakthroughs
- The 2017 paper "Attention is All You Need" invented transformer models powering many AI breakthroughs.
- Transformers excel beyond language in tasks like protein structure prediction and image generation.
Humans Read Non-Linearly
- Most previous models read sentences left to right slowly, missing complex dependencies.
- Humans understand language non-linearly, jumping back and forth to grasp meaning.
GPUs Inspired Transformer Design
- GPUs excel at many simple computations in parallel rather than complex sequential operations.
- This inspired processing all words simultaneously with simpler operations for better speed and effectiveness.