The Differences Between Open Source and Open Source Language Models

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The original models were open source. How much overlap is there in the fundamental technology at this point and how much is different? If we were to take the top five language models, how much shared DNA do they actually have? How different are they at their cores? So everything is a transformer, which is the architecture built by Google in 2017. And everything is generatively pre-trained with language models.

This Week in Startups is presented by: Crowdbotics. Great ideas can change the world, and Crowdbotics is the fastest way to turn those ideas into code. Get a free scoping session for your next big app idea at crowdbotics.com/twist Vanta. Compliance and security shouldn't be a deal-breaker for startups to win new business. Vanta makes it easy for companies to get a SOC 2 report fast. TWiST listeners can get $1,000 off for a limited time at vanta.com/twist OpenPhone. Create business phone numbers for you and your team that work through an app on your smartphone or desktop. TWiST listeners can get an extra 20% off any plan for your first 6 months at openphone.com/twist

Today’s show:

Perplexity’s Aravind Srinivas joins Jason to discuss competing with the major players in the generative search / AI chatbot market (1:25), designing an AI-powered search engine (4:49), and much more. *

Check out Perplexity: https://www.perplexity.ai/

Follow Aravind: https://twitter.com/AravSrinivas

Time stamps:

(00:00) Perplexity CEO Aravind Srinivas joins Jason

(1:25) Competing in the generative search / AI chatbot market

(4:49) How Perplexity's AI model formulates answers

(11:18) Crowdbotics - Get a free scoping session for your next big app idea at https://crowdbotics.com/twist

(12:46) How Perplexity is citing sources

(20:20) Incorporating advertising into AI chatbots

(25:32) Vanta - Get $1000 off your SOC 2 at https://vanta.com/twist

(26:40) How Perplexity recruits talent and Aravind's time at OpenAI

(32:04) The future of AI technology and overcoming overlap