The WAN Show cover image

I Can’t Believe I’m Still Talking About Honey - WAN Show January 3, 2025

The WAN Show

CHAPTER

Challenges of Web Crawling and LLM Bots

This chapter explores the impact of large language model training bots on web infrastructure, presenting a critical investigation into web crawling practices. It discusses the inefficiencies and challenges faced by online platforms due to unchecked bot activity, while reflecting on the disillusionment surrounding the maintenance of online communities.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner