Anton Troynikov, cofounder of Chroma, discusses the importance of keeping the retrieval-augmented generation (RAG) loop in house, Chroma being in “wartime” mode, and the challenge of incorporating data never before in a database. They delve into the shift from agents to RAG in the AI space, scaling challenges of a retrieval system, best practices for improving search results, increasing data and creating business value, improving the stack and solving RAG problems, the importance of evaluations and trade-offs, searching and retrieving data, and model reactions and generalizability.

We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.(0:00) Preview(1:17) Sponsor (4:00) Anton breaks down the advantages of vector databases(4:45) How embeddings have created an AI-native way to represent data(11:50) Anton identifies the watershed moment and step changes in AI(12:55) Open AI’s pricing(18:50) How chroma works(33:04) Stable Attribution and systematic bias(36:48) How latent diffusion models work(51:26) How AI is like the early days of aviation(56:01) How Disney inspired the release of Stable Attribution(59:53):Why noise can lead to generalization(1:01:04) Nathan’s KPI for The Cognitive Revolution(1:01:59) Other use cases for embedding(1:03: 19) Anton touches on the applications for biotech(1:04:35) Anton on doomerism hysteria and what actually worries him(1:11:43) - Nathan sums up a plausible doomer scenario(1:20:17)What AI tools does Anton use and why?(1:22:55) Anton’s hopesSPONSORS: SHOPIFY | OMNEKYShopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive*Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Twitter:@CogRev_Podcast@atroyn (Anton)@labenz (Nathan)@eriktorenberg (Erik)Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/Websites:cognitivervolution.aitrychroma.com/omneky.com Show Notes & references:-https://same.energy/ (Beta)-Wright Brothers Bio (https://www.amazon.com/Wright-Brothers-David-McCullough/dp/1476728755)-Ajeya Cotra article in Less Wrong (https://www.lesswrong.com/posts/pRkFkzwKZ2zfa3R6H/without-specific-countermeasures-the-easiest-path-to)RECOMMENDED PODCAST:The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.https://link.chtbl.com/hrhereticsThis show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Anton Troynikov of Chroma and Flo Crivello of Lindy AI join The Cognitive Revolution cohosts Nathan Labenz and Erik Torenberg to debate the issues raised in the AI open letter, which advocates for a 6-month pause on AI system trainings.This episode was recorded on March 31st and was first released as a Moment of Zen episode (airing April 1). Subscribe to Moment of Zen for more timely debates like this one!Also, check out the debut of Erik's new long-form interview podcast Upstream, whose guests in the first two episodes were Balaji Srinivasan and Marc Andreessen. This coming season will feature interviews with Ezra Klein, David Sacks, Katherine Boyle, and more. Subscribe here:Apple Podcasts: bit.ly/3z8TldLSpotify: bit.ly/40letd0We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.RECOMMENDED PODCAST:The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.https://link.chtbl.com/hrhereticsLINKS REFERENCED IN EPISODE: Open letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/Scott Aronson blog post: https://scottaaronson.blog/TIMESTAMPS:(0:00) Preview of debate(3:10) Introduction from Nathan and explanation of the AI open letter(8:50) Anton’s skepticism of the open letter(12:14) Flo’s skepticism of the open letter(16:35) Nathan’s support for the open letter(22:52) Sponsor: Omneky(28:00) Differences between Flo and Anton’s positions(34:00) GPT4 is still dangerous(42:30) Luddites/“Pausers” are on the wrong side of history(47:44) Why not pause for 6 months?(56:30) Anton and Flo debate robotics(1:04:30) What we’re all scared of with AI(1:27:45) Is there an asymmetric risk with pausing or not pausing?TWITTER:@CogRev_Podcast@atroyn (Anton)@labenz (Nathan)@eriktorenberg (Erik)@altimor (Flo)SPONSORS:Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveThank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/Thank you to Graham Bessellieu for production.

Anton Teaches Packy AI is Not Boring's attempt at making AI more accessible to our audience. It's become increasingly obvious that we're in the Golden Age of AI, so we think it's important to demystify what's going on and how it all actually works.   Anton Troynikov is the founder of Chroma, former Meta Reality Labs Research Engineer and Roboticist.   Packy McCormick is the author of the popular tech and buinsess strategy newsletter, Not Boring.   Anton Teaches Packy AI is exactly what it sounds like -- each video, Anton breaks down AI to a level that Packy (your average above average smart person) can understand.   In Episode 1, Anton and Packy discuss the groundbreaking "Attention is All You Need" research paper which kicked off the entire Transformer generative AI wave.    LINKS:  - Attention is All You Need: https://arxiv.org/abs/1706.03762 - The Bitter Lesson: http://www.incompleteideas.net/IncIdeas/BitterLesson.html - Training Compute-Optimal Large Language Models: https://arxiv.org/abs/2203.15556 - Explain Paper: https://www.explainpaper.com/ --- Send in a voice message: https://podcasters.spotify.com/pod/show/ageofmiracles/message

Anton Troynikov of Chroma, Flo Crivello of Lindy AI, and Nathan Labenz of Waymark and co-host of The Cognitive Revolution podcast join Erik Torenberg for a timely debate on the issues raised in the AI open letter which advocates for a 6-month pause on AI system trainings. Dan and Antonio will be back next week. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/zenCheck out the debut of Erik's new longform interview podcast Upstream. This coming season features interviews with Marc Andreessen, Balaji Srinivasan, Ezra Sacks, David Sacks, Katherine Boyle, and more. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.LINKS:Open letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/Scott Aronson blog post: https://scottaaronson.blog/TIMESTAMPS:(3:00) Explanation of the AI open letter(3:50) Anton’s skepticism of the open letter(7:00) Flo’s skepticism of the open letter(13:00) Nathan’s support for the open letter(15:39) Sponsors(20:00) Differences between Flo and Anton’s positions(30:00) GPT4 is still dangerous(38:00) Luddites/“Pausers” are on the wrong side of history(42:00 )Why not pause 6 months?(50:00) Anton and Flo debate robotics(56:00) What we’re all scared of with AI(1:21:00) Is there asymmetric risk with pausing or not pausing?TWITTER:@MOZ_Podcast@atroyn (Anton)@labenz (Nathan)@eriktorenberg (Erik)@altimor (Flo)SPONSORS: Beehiiv | Shopify | Netsuite | SecureframeHead to Beehiiv, the newsletter platform built for growth, to power your own. Connect with premium brands, scale your audience, and deliver a beautiful UX that stands out in an inbox. 🐝 to https://Beehiiv.com and use code “MOZ” for 20% off your first three months-Shopify: https://shopify.com/momentofzen for a $1/month trial periodShopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of all e-commerce in the US. And Shopify’s the global force behind Allbirds, Rothy’s, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries. From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you’re selling, Shopify’s got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/momentofzen-NetSuite: http://netsuite.com/zenNetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ NetSuite: http://netsuite.com/zen and defer payments of a FULL NetSuite implementation for six months.-SecureFrame: www.secureframe.comSecureframe is the leading all-in-one platform for security and privacy compliance. Get SOC-2 audit ready in weeks, not months. I believe in Secureframe so much that I invested in it, and I recommend it to all my portfolio companies. Sign up for a free demo and mention MOMENT OF ZEN during your demo to get 20% off your first year.