The WAN Show cover image

I Can’t Believe I’m Still Talking About Honey - WAN Show January 3, 2025

The WAN Show

00:00

Challenges of Web Crawling and LLM Bots

This chapter explores the impact of large language model training bots on web infrastructure, presenting a critical investigation into web crawling practices. It discusses the inefficiencies and challenges faced by online platforms due to unchecked bot activity, while reflecting on the disillusionment surrounding the maintenance of online communities.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app