This Week in Startups is presented by: Vanta. Compliance and security shouldn't be a deal-breaker for startups to win new business. Vanta makes it easy for companies to get a SOC 2 report fast. TWiST listeners can get $1,000 off for a limited time at vanta.com/twist. Trovata. Starting up is hard. Trovata makes managing cash easy. Start automating your cash management at Trovata.io/TWIST. Use Code TWIST for 30% off one full year of premium features like AI forecasting. The Microsoft for Startups Founders Hub helps all founders build a better startup, at a lower cost, from day one. Startups get up to $150K in Azure credits, access to free OpenAI credits, free dev tools like GitHub, technical advisory, access to mentors and experts, and so much more. There is no funding requirement, and it only takes minutes to join. Sign up today at aka.ms/thisweekinstartups * Todays show: MosaicML Co-Founder and CEO Naveen Rao joins Jason to discuss the open-source vs closed AI debate, the profound impact of AI on society (41:06) AI’s rapid pace of change, and its implications for the future of employment and education (40:42). They wrap the show by breaking down the potential problems with centralized regulation (54:37). Follow Naveen: https://twitter.com/NaveenGRao Check Out MosaicML: https://mosaicml.com * Time stamps: (00:00) Naveen Rao joins Jason (2:54) MosaicML and its purpose (5:10) Obtaining datasets and incentivizing creators (8:30) Vanta - Get $1000 off your SOC 2 at https://vanta.com/twist (9:37) The process of using your data with MosaicML (11:55) Defining tokens and prompts (16:53) Fine-tuning the AI model and reinforcement learning (19:27) The competition with open-source models (24:26) The cost of running AI models (26:08) Trovata - Use code TWIST at https://trovata.io/twist for 30% off one year of premium features, like AI forecasting (27:35) How the GPU crunch has affected cloud models (32:13) Why demand will not cease (34:21) Specialized models vs. general models (39:12) Microsoft for Startups Founders Hub - Apply in 5 minutes for six figures in discounts at http://aka.ms/thisweekinstartups (40:42) The impact AI will have on employment (48:49) The impact AI will have on education (54:37) Thoughts on OpenAI becoming ClosedAI * Read LAUNCH Fund 4 Deal Memo & Apply for Funding Buy ANGEL Great recent interviews: Brian Chesky, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland, PrayingForExits, Jenny Lefcourt Check out Jason’s suite of newsletters: https://substack.com/@calacanis * Follow Jason: Twitter: https://twitter.com/jason Instagram: https://www.instagram.com/jason LinkedIn: https://www.linkedin.com/in/jasoncalacanis * Follow TWiST: Substack: https://twistartups.substack.com Twitter: https://twitter.com/TWiStartups YouTube: https://www.youtube.com/thisweekin * Subscribe to the Founder University Podcast: https://www.founder.university/podcast

There are many speculations about the future of artificial intelligence (AI), and in this episode, we hear the opinions and predictions of a player in the inner folds of the AI space. Naveen Rao is the CEO and Co-Founder of the machine learning (ML) training platform, MosaicML, and the former CEO and Co-Founder of Nervana Systems. Naveen shares insight into the thesis behind Mosaic and the practical applications of Large Language Models (LLMs), as well as the Generative Pre-trained Transformer-2 (GPT-2) to GPT-3 transition and the challenge of training models with the constraint of data limits. He predicts the evolution of AI models in terms of quantity, size, and function, and the future of computers in general. If you’re curious as to whether it makes sense to build smaller models or own your own model, this episode is for you. Tune in to hear Naveen’s opinions on the impact of AI on the economy, the danger of centralizing resources, what constitutes sentience, and much more. “What we’re doing at Mosaic is building tools to enable more people to have access to these technologies. When it’s all centralized in one or two or three players, that creates a huge power dynamic.” — @NaveenGRao Key Points From This Episode: Naveen Rao’s educational background and interest in synthetic intelligence. What led him to start his first AI company, Nervana Systems. The thesis behind MosaicML. What MosaicML offers customers. What Naveen considers to be 2022’s most exciting breakthrough in AI. The innovation of ChatGPT. The GPT-2 to GPT-3 transition. The challenge of training models with the constraint of data limits. Naveen explains the concept of synthetic data. He predicts the evolution of AI models in terms of quantity, size, and function. Why it makes sense to build smaller models and own your own model where possible. Data as a moat component. Practical applications of LLMs. Naveen’s opinion on whether AI will disrupt the economy or increase Gross Domestic Product (GDP). The danger of the centralization of resources. How MosaicML is making trading more efficient given the limits AI is facing. The efficiency improvements MosaicML customers are seeking out. Naveen’s prediction for the rate of cost decline. The history of the computer password. The future of computers. The question of what constitutes sentience. Naveen recounts the acquisition process of selling Nervana Systems to Intel. How the innovator’s dilemma will play out among competitors in the AI space. Naveen’s advice for his past self.

Naveen Rao, CEO of MosaicML, discusses the evolving landscape of AI, emphasizing the challenges of open-source versus closed-source models amidst regulatory scrutiny. He dives into advancements in AI models like Meta's Llama, highlighting their future potential. Elliot Easterling, CEO of Bonbon.tech, shares insights on enhancing publisher engagement through gamified rewards. They explore how innovative strategies can drive user monetization while addressing budget constraints in a competitive market.

Naveen Rao, VP of AI at Databricks and a pioneer in AI with founding roles at Nervana Systems and MosaicML, joins to discuss the enterprise LLM market's evolution. They explore NVIDIA's market dominance and the significance of hardware choices in AI development. Rao sheds light on the trend toward domain-specific models and the shift from supervised to self-supervised learning. He also addresses the challenges in transforming data into actionable insights and the transformative impact of LLMs in business, particularly in regulated environments.

Naveen Rao, VP of generative AI at Databricks, discusses enterprise LLMs and generative AI, highlighting the evolution of language models, challenges in building custom chips, and the effectiveness of domain-specific small models. The conversation also explores the transition towards a hybrid learning approach, regulating generative models, and Naveen's transformative journey from computer architecture to AI innovation.

Naveen Rao, founder of MosaicML, discusses the efficiency of the human brain, slashing the cost to train AI models, the evolution of the car, selling to Databricks, the future of the AI market, and more.

Naveen Rao, VP of AI at Databricks, has a rich background in AI hardware and software, having previously founded Nervana and MosaicML. He shares his journey from a childhood fascination with science fiction to innovating in AI. The conversation dives into the distinct playbooks required for deep tech versus SaaS, emphasizing a deeper understanding of problems. He discusses the shifting landscape of AI post-ChatGPT, the synergy between hardware and software, and the future of AI training and decision-making, advocating for breakthrough innovations to navigate evolving demands.

Guest Naveen Rao, VP of Generative AI at Databricks, discusses the current state of AI, challenges in generative AI scaling, AI pretraining difficulties, and opportunities for generative AI startups. They also talk about open source AI competition, AI hardware landscape, and the pace of AI innovation.

Naveen Rao, VP of generative AI at Databricks, discusses neural networks, human vs. machine compute, the future of AI and LLMs, Databricks’ AI initiatives, competition landscape, and building scalable AI solutions for enterprises with Sunil Rajgopal on the Tech Disruptors podcast.

Naveen Rao, CEO and co-founder of Mosaic ML, discusses the transformative potential of open-source AI and the challenges posed by evolving regulations. He shares insights on the integration into Databricks and the importance of ethical AI practices. Elliot Easterling, CEO of Bonbon.tech, highlights innovative rewards strategies that enhance user engagement for publishers, utilizing machine learning and gamification to drive deeper customer relationships. Both guests emphasize the shifting dynamics in technology and the importance of adaptive strategies in today’s landscape.