James McLoughlin shares that crawling and indexing management needs to be a corner stone of your SEO strategy in 2026, ensuring crawlers (both traditional search engine crawlers and LLM crawlers) can quickly and easily discover, understand and index any content you want surfaced in search engines and LLMs.
Talking points include:
What does crawling and indexing management mean in practice in 2026?
How do you ensure that crawlers (both traditional search engine crawlers and LLM crawlers) can quickly and easily discover, understand and index any content you want surfaced?
What is the difference between crawling and indexing management for traditional search engines versus LLMs?
How do you determine the content you want to be surfaced?
What do you do with the content you don’t want to be surfaced?
How does this feed into your content marketing strategy?
