Exploring the Trade-offs of Synchronous vs. Asynchronous Gradient Updates

In this episode of High Agency, we are speaking to Paras Jain who is the CEO of AI video generation startup Genmo. Paras shares insights from his experience working on autonomous vehicles, why he chose academia over an offer from Tesla, and the research-minded approach that has lead to Genmo's rapid success.

Chapters:
(00:00) Introduction
(01:52) Lessons from selling an AI company to Tesla
(07:01) Working within GPU constraints and transformer architecture
(11:18) Moving from research to startup success
(14:36) Leading the video generation industry
(16:05) Training diffusion models for videos
(19:36) Evaluating AI video generation
(24:06) Scaling laws and data architecture
(28:34) Issues with scaling diffusion models 
(33:09) Business use cases for video generation models
(36:43) Potential and limitations of video generation
(40:59) Ethical training of video models