
I Can’t Believe I’m Still Talking About Honey - WAN Show January 3, 2025
The WAN Show
Challenges of Web Crawling and LLM Bots
This chapter explores the impact of large language model training bots on web infrastructure, presenting a critical investigation into web crawling practices. It discusses the inefficiencies and challenges faced by online platforms due to unchecked bot activity, while reflecting on the disillusionment surrounding the maintenance of online communities.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.