Search Off the Record Crawling smarter, not harder
Aug 8, 2024
Join John Mueller, a search engine optimization expert, Lizzi Sassman, a web crawling specialist, and Gary Illyes, a leader in search technology, as they delve into the myths of crawl frequency and the hurdles of modern web crawling. They discuss the balance between site quality and crawl rates, emphasize optimizing website efficiency with smart sitemaps, and explore innovative crawling methods that focus on changes rather than entire pages. Tune in for insights on enhancing your site's crawlability and navigating the complexities of search technology!
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7
Intro
00:00 • 2min
Understanding Googlebot: Myths and Strategies
01:47 • 10min
Optimizing Website Efficiency
11:53 • 5min
Optimizing Web Crawling: Focused Changes Over Complete Analysis
17:07 • 3min
Navigating the Complexities of Web Page Structure
20:00 • 2min
Navigating the Complexities of Web Crawling
22:01 • 16min
Communicating Crawling Challenges
38:05 • 2min