A New Approach to Building Search Indexes

1min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The traditional approach to search indexes involved crawling around and finding everything. However, a new approach involves building the index based on user engagement online, rather than blindly following every link. This innovative tactic focuses on how to make it work better for users and aims for richer content rather than just a larger index.

In this episode, Nathan sits down with Richard Socher, CEO and Founder of You.com, a personalized AI search assistant. They discuss the rise of the AI chatbot paradigm and how that's changed the game for search, You.com's various modes, with particular emphasis on Genius mode and above all Research mode, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

LINKS:

- You.com: https://you.com/

-Richard Socher's site: https://www.socher.org/

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.

X/SOCIAL:

@labenz

@RichardSocher (Richard)

@YouSearchEngine

@CogRev_Podcast

TIMESTAMPS:

(00:00) Preview

(01:38) Interview with Richard Socher: AI pioneer

(02:26) Exploring the You.com product

(02:55) The AI Bundle

(05:23) Richard Socher's journey in deep learning

(16:43) You.com comparison to competitors

(31:16) The future of AI search engines

(41:38) The changing landscape of search engines

(41:44) The impact of chatbots and AI on search

(42:16) How the market will shape up

(43:33) The power of open source

(01:02:32) The role of AI in advancing science

(51:42) The future of AI: philosophical and practical considerations

(55:06) The future of AI: risks and regulations

(01:11:07) The future of AI: agency and emergence

(01:26:57) The future of AI: retrieval, memory, and online learning

This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.