Sitemap (sitemap.xml)

A sitemap (typically /sitemap.xml) lists every URL a search engine should know about, along with optional metadata: lastmod (when the URL last changed), changefreq, and priority. The format is defined by sitemaps.org and supported by every major search engine.

Sitemaps are especially important for new sites with little inbound linking and for large sites with deep navigation. They're how Google finds URLs that aren't linked from anywhere obvious — programmatic pages (/vs/[X], /industries/[Y], etc.), recently published blog posts, archive pages.

For sites with more than 50,000 URLs, split into multiple sitemaps and reference them from a sitemap index file. Most large sites organize by content type: sitemap-pages.xml, sitemap-blog.xml, sitemap-products.xml. Each child sitemap can hold up to 50,000 URLs or 50MB uncompressed.

Submit your sitemap in Google Search Console and Bing Webmaster Tools. For faster indexation of new URLs, also ping Google's IndexNow API (Bing, Yandex, and Seznam are the main IndexNow consumers as of 2026) — submission speeds up discovery from 'days' to 'hours' for high-authority domains.

Common sitemap mistakes: including non-canonical URLs (URLs with tracking parameters, paginated archive pages), including 404 / redirected URLs (signals poor site hygiene to Google), forgetting to update lastmod when content actually changes (Google deprioritizes sitemaps with stale lastmod), and not referencing the sitemap from robots.txt.