This Week in Startups

The state of modern answer engines, AI demos, and more! | E1924

21 snips
Apr 3, 2024
Guest
Sunny Madra
Sunny Madra, GM of Groq Cloud, dives into the transformative landscape of modern AI search engines. He discusses the rising costs and efficiency of running AI queries, highlighting new contenders like You.com and Perplexity. The conversation navigates the shifting terrain of SEO and the necessity for accuracy in search results amid traditional giants. Sunny also demos innovative AI products, exploring their potential to disrupt conventional methods of information retrieval and the future of user engagement in the digital space.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Search Engine Disruption

  • Open-source models and decreasing inference costs are making search engines cheaper.
  • This allows smaller search engines like Perplexity to operate with 50 million users.
ANECDOTE

Decreasing Storage Costs

  • Storage costs have drastically decreased: a 10TB hard drive now costs $200.
  • In large data centers, dead hard drives are sometimes left in place because replacement is not cost-effective.
INSIGHT

Proprietary Models Lead

  • Top-ranked language models on the LMSYS Chatbot Arena leaderboard are proprietary.
  • This suggests they're trained on private or synthetic data and/or more human feedback.
Get the Snipd Podcast app to discover more snips from this episode
Get the app