Unsupervised Learning

Alex Ratner, CEO of Snorkel AI, discusses the growth of Snorkel, importance of data development in AI, barriers to enterprise AI adoption, and the role of academia in AI progress. Topics include avoiding errors in pre-training, enterprise AI deployment challenges, future AI regulation, and over-hyped AI models.

On today’s episode we talk with Jeff Huber, the CEO and Co-founder of Chroma. We talk about what sets Chroma apart from its competitors, new developments in AI technology, and advice for listeners who want to get started in AI. 0:00 intro 1:02 starting chroma 6:08 vector databases 10:03 interesting use cases for vector databases 13:14 what sets chroma apart? 23:00 unresolved questions in LLMs 32:45 multiple agents vs. one agent to rule them all 34:50 chroma’s future 38:00 embedding models 43:00 over-hyped/under-hyped 44:30 AI regulation 48:42 is it too late to get into AI?  With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health @jordan_segall - Partner at Redpoint

Jacob sits down with PathAI Ceo Dr. Andy Beck to discuss the state of AI adoption in diagnosis, why Path acquired their own lab, pathologists' jobs in the future and nailing GTM to reach a ~$1B valuation.  00:00 intro 01:01 pathology and AI 13:30 nailing go-to-market strategy 19:47 how pathology labs can go digital 25:36 regulatory frameworks and roadblocks 33:05 do improvements in foundation models impact PathAI? 36:26 standardizing diagnosis 40:05 how will the job of a pathologist change going forward? 42:35 NASH 47:30 working in Daphne Koller’s lab With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health @jordan_segall - Partner at Redpoint

Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more. 0:00 intro01:06 Aran’s background02:58 starting work on gpt-j05:49 gathering data for Lion and gpt-j08:51 history of EleutherAI11:16 open vs. closed-source models19:06 how will open-source models be used going forward21:33 thought cloning25:51 building AI models that understand video29:35 one model to rule them all31:58 influence of academia in the LLM space34:33 over-hyped/under-hyped38:01 Aran’s thoughts on AGI With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health@jordan_segall - Partner at Redpoint

Patrick and Jacob sit down with Tatsu Hashimoto, Professor of AI at Stanford, to discuss the incredible open source projects from his research group like Alpaca and AlpacaFarm, whether data, algorithms, fine-tuning or RLHF is most important for performance, if AI is liberal or conservative, and much more! (0:00) - intro(1:05) - journey to Stanford(2:50) - origins of Alpaca(6:08) - capabilities of the Alpaca model(16:39) - the future of AI(20:07) - AlpacaFarm(21:37) - how to improve language models(29:15) - do language models form opinions?(32:15) - how to solve bias in ai(34:18) - how does academia fit into the world of AI(42:01) - over-hyped/under-hyped(46:35) - questions Tatsu doesn’t have time for With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health@jacobeffron - Partner at Redpoint, Former PM Flatiron Health

Jacob sits down with Insitro CEO Daphne Koller to discuss founding Coursera, where and how ML can drive the most impact in drug development, and if foundation models can transform core drug discovery work and edtech.  (00:00) - intro (00:54) - Daphne’s journey (09:18) - AI and biology discovery (10:59) - insitro vs. traditional pharma (20:04) - phenotyping patients (26:01) - early mistakes (29:51) - the future of data (35:33) - partnering with larger pharma companies (38:17) - impact of LLMs on biopharma (44:04) - over-hyped/under-hyped  With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health

Jacob sits down with OpenAI VP of Product & Partnerships Peter Welinder and guest host Rob Toews (Radical VC Partner) to discuss OpenAI’s strategy, how they think about what they will/won’t build, the future of open source models and when we’ll reach AGI.  (00:00) - intro(00:42) - where is the value in AI?(07:51) - how OpenAI prioritizes projects(14:15) - open-source AI(25:49) - gaps in AI(29:36) - risks and downsides(34:02) - when will we reach super-intellegence?(40:40) - super-intellegence safety(43:37) - how OpenAI uses ChatGPT With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health@jacobeffron - Partner at Redpoint, Former PM Flatiron Health

Jacob sits down with ex-DeepMind / White House operator Teddy Collins to discuss Sam Altman’s Congressional testimony, how AI can enable direct democracy, state-driven economic planning and better orgs, US-China competition and more. (00:00) - intro(01:15) - how Teddy came to the AI world(06:26) - working in government(12:27) - AI regulation and Sam Altman testimony(19:19) - the end of humanity(34:34) - nearer term issues with AI(41:10) - how the government can use AI(47:13) - lessons from DeepMind(54:54) - over-hyped/under-hyped With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Patrick and Jacob sit down with Mike Conover, Staff Software Engineer at Databricks and Co-Creator of Databricks Dolly, the world’s first truly open instruction-tuned LLM, to discuss the magic behind Dolly, Alpaca and other instruction-tuned LLMs, the unreasonable effectiveness of fine-tuning, how they got all Databricks employees to help them curate the Dolly dataset (hint: google forms), and more. (0:00) - Intro(5:54) - The birth of Dolly(12:03) - Data curation at Databricks(15:34) - Advice for building LLMs(24:10) - The future of instruction-tuning datasets(30:43) - UI innovation(38:16) - The future of machine learning infrastructure(42:05) - How SkipFlag would be different with the tools we have today(47:01) - What Mike has learned since Dolly With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Jacob and Erica sit down with Jasper CEO Dave Rogenmoser to discuss the future of writing with AI and what it means for marketers and the internet, Jasper post ChatGPT, hosting a massive Gen AI conference, going upmarket and more.(00:56) - How Jasper works and how people are using it(02:00) - Dave's journey leading up to Jasper(04:30) - The moment Dave knew he was onto something with Jasper(07:30) - Where Jasper works well for business applications(10:55) - How the content of the internet might change going forward with the use of AI for content creation(13:00) - What a writer's workflow in the future looks like with AI(14:50) - How the introduction of ChatGPT impacted Jasper(17:46) - Looking at the long term opportunity for differentiation for Jasper(23:16) - Tuning a 'brand voice' through Jasper's AI(26:15) - Jasper's role in bringing community together, ie with their recent Gen AI Conference(30:00) - How Dave thinks about the future of work for his kids(32:20) - The productivity boost clients see through using Jasper(37:00) - Quick fire round With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health