No Priors: Artificial Intelligence | Technology | Startups AI-Powered Biological Software with Jakob Uszkoreit, CEO of Inceptive
75 snips
Aug 24, 2023 Jakob Uszkoreit, CEO and Co-founder of Inceptive, is a deep learning pioneer who previously co-authored the game-changing paper 'Attention is All You Need' at Google. In this conversation, he delves into the future of biological software and its pivotal role in optimizing mRNA therapies and vaccine production. He highlights the innovative intersection of deep learning and biology, discussing challenges in drug discovery and the promise of simpler model architectures driven by hardware advancements. Collaborations at Inceptive showcase the exciting frontier of biotechnological research.
AI Snips
Chapters
Transcript
Episode notes
Hardware-Driven Deep Learning
- Deep learning breakthroughs require efficient implementation on hardware.
- Optimizing for hardware constraints is crucial for pushing deep learning forward.
Untested Architectures
- Transformer models' interesting properties emerge at scale, but other architectures might also have them.
- Testing those architectures at scale is hindered by compute costs and hardware limitations.
Inefficient Compute Allocation
- Compute allocation in current models is inefficient, scaling with prompt/response length, not problem difficulty.
- LLMs should adjust compute based on problem complexity, not input/output size.