Unsupervised Learning

Jacob sits down with OpenAI VP of Product & Partnerships Peter Welinder and guest host Rob Toews (Radical VC Partner) to discuss OpenAI’s strategy, how they think about what they will/won’t build, the future of open source models and when we’ll reach AGI.  (00:00) - intro(00:42) - where is the value in AI?(07:51) - how OpenAI prioritizes projects(14:15) - open-source AI(25:49) - gaps in AI(29:36) - risks and downsides(34:02) - when will we reach super-intellegence?(40:40) - super-intellegence safety(43:37) - how OpenAI uses ChatGPT With your co-hosts: @jasoncwarner - Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron - Partner at Redpoint, Former PM Flatiron Health@jacobeffron - Partner at Redpoint, Former PM Flatiron Health

Jacob sits down with ex-DeepMind / White House operator Teddy Collins to discuss Sam Altman’s Congressional testimony, how AI can enable direct democracy, state-driven economic planning and better orgs, US-China competition and more. (00:00) - intro(01:15) - how Teddy came to the AI world(06:26) - working in government(12:27) - AI regulation and Sam Altman testimony(19:19) - the end of humanity(34:34) - nearer term issues with AI(41:10) - how the government can use AI(47:13) - lessons from DeepMind(54:54) - over-hyped/under-hyped With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Patrick and Jacob sit down with Mike Conover, Staff Software Engineer at Databricks and Co-Creator of Databricks Dolly, the world’s first truly open instruction-tuned LLM, to discuss the magic behind Dolly, Alpaca and other instruction-tuned LLMs, the unreasonable effectiveness of fine-tuning, how they got all Databricks employees to help them curate the Dolly dataset (hint: google forms), and more. (0:00) - Intro(5:54) - The birth of Dolly(12:03) - Data curation at Databricks(15:34) - Advice for building LLMs(24:10) - The future of instruction-tuning datasets(30:43) - UI innovation(38:16) - The future of machine learning infrastructure(42:05) - How SkipFlag would be different with the tools we have today(47:01) - What Mike has learned since Dolly With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Jacob and Erica sit down with Jasper CEO Dave Rogenmoser to discuss the future of writing with AI and what it means for marketers and the internet, Jasper post ChatGPT, hosting a massive Gen AI conference, going upmarket and more.(00:56) - How Jasper works and how people are using it(02:00) - Dave's journey leading up to Jasper(04:30) - The moment Dave knew he was onto something with Jasper(07:30) - Where Jasper works well for business applications(10:55) - How the content of the internet might change going forward with the use of AI for content creation(13:00) - What a writer's workflow in the future looks like with AI(14:50) - How the introduction of ChatGPT impacted Jasper(17:46) - Looking at the long term opportunity for differentiation for Jasper(23:16) - Tuning a 'brand voice' through Jasper's AI(26:15) - Jasper's role in bringing community together, ie with their recent Gen AI Conference(30:00) - How Dave thinks about the future of work for his kids(32:20) - The productivity boost clients see through using Jasper(37:00) - Quick fire round With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Jacob and Erica sit down with You.com CEO and former Salesforce Chief Scientist Richard Socher to discuss building a new search engine and the future of search, his predictions on when open source models will catch up to GPT-4, AGI and more.(1:29) - Richard's career moves and what motivated them(6:44) - More about You.com and the ethos behind the company(9:47) - How You.com integrates 3rd-party apps(13:30) - Richard's thoughts on the future of AI(23:19) - The role of academia in the world of AI going forward(27:30) - Things in AI that Richard is excited about(31:53) - Quickfire Round With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Jordan and Erica chat with Fixie.ai co-founder and former Harvard CS professor on the journey from researcher to Google eng leader and then to startup life prior to founding Fixie, a new platform for building LLM-based apps (a Redpoint portfolio company). We also talk about having Mark Zuckerberg in his CS class, ChatGPT Plugins and the AI ecosystem, and what the future might look like for our kids with AGI. You can find Matt on Twitter (@mdwelsh) and learn more about Fixie at https://www.fixie.ai/(1:06) - Matt talks about his early days at Berklee and Harvard(6:45) - Making the jump to the start-up world(8:15) - Matt explains what Fixie does(11:30) - How Matt thinks about use cases for Fixie(14:20) - How work might change with AI's integration(17:04) - The future of LLM's(20:30) - Matt's take on the race to AGI (25:20) - How Matt thinks about the future of the world for his kids and how they might use AI(29:24) - Quick fire round With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Jacob and Jason sit down with NEAR CEO and Transformer paper author Illia Polosukhin. They discuss Illia’s fascinating journey from Ukraine to Google and AI to crypto, the origin story behind the “Attention Is All You Need” paper and the overlap between AI and crypto. Illia also shared his thoughts on AGI and the problems that excite him most in AI right now. You can find Illia on Twitter (@ilblackdrago) and learn more about NEAR (@nearprotocol)(00:39) - Welcoming Illia; how he became interested in AI, transitioning into Crypto and explaining NEAR (02:40)  - Walking through Illia's story more in depth(07:46) - How the Transformer Paper came to be(11:24) - Understanding the Transformer Papers' impact(18:28) - The overlap of Crypto and AI and how Illia sees the future of how they develop together(26:47) - Illia's views on AGI(30:46) - Optimism vs pessimism of the future of machine learning as a tool(41:32) - What problems Illia sees in AI right now(45:03) - Rapid fire questions(47:36) - Where to learn more about NEAR and Illia With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health 

Patrick and Jacob sit down with Matei Zaharia, Co-Founder and CTO at Databricks and Professor at Stanford. They discuss how companies are training and serving models in production with Databricks, where LLMs fall short for search and how to improve them, the state of the art AI research at Stanford, and how the size and cost of models is likely to change with technological advances in the coming years. (0:00) - Introduction(2:04) - Founding story of Databricks(6:03) - PhD classmates using early version of spark for Netflix competition(6:55) - Building applications with MLFlow(9:55) - LLMs and ChatGPT(12:05) - Working with and fine-tuning foundation models(13:00) - Prompt engineering here to stay or temporary?(15:12) - Matei’s research at Stanford. The Demonstrate-Search-Predict framework (DSP)(17:42) - How LLMs will be combined with classic information retrieval systems for world-class search(19:38) - LLMs writing programs to orchestrate LLMs(20:36) - Using LLMs in Databricks cloud product(24:21) - Scaling LLM training and serving(27:29) - How much will cost to train LLMs go down in coming years?(29:22) - How many parameters is too many?(31:14) - Open source vs closed source?(35:19) - Stanford AI research - Snorkel, ColBERT, and More(38:58) - Matei getting a $50 amazon gift card for weeks of work(43:23) - Quick-fire round With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Jacob and Jason sit down with Hugging Face CEO Clem Delangue and discuss trends in who’s using Hugging Face, the future of closed source vs open source in machine learning, why Clem compares large closed foundation models to Formula One Cars, how enterprise AI teams will evolve and AI safety. (0:00) - Introduction(1:37) - Welcome Clem(1:57) - Starting Hugging Face(5:42) - Influence of ChatGPT(15:47) - Use cases of large vs. small platforms(18:44) -  Should large language models be open?(30:20) - What’s next for Hugging Face?(43:06) - Rapid fire(47:02) - Learn more about Hugging Face With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical @ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare) @patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn @jacobeffron- Partner at Redpoint, Former PM Flatiron Health