Skip to content
Scheidegger Webpublishing Webpublishing, Switzerland
← All articles

The sitemap declares, the link gets crawled

What a sitemap actually does, when Google itself says it is not always necessary, and the two mistakes that make it counterproductive. Beginners' SEO series, part four.

2 min read

The sitemap is the most overrated object in beginner SEO. People think they are submitting a list and getting indexing in return; what they are actually submitting is a declaration, which Google treats as such: a hint, not an order.

What it is

A sitemap is a file, most often in XML format, that lists the addresses of a site’s pages, with their last modification date where needed. Google reads it to discover pages and to prioritise its visits. Its documentation says two things that must be read together: the sitemap helps, and many sites do not need one. A small site whose pages are all reachable through internal links will be discovered anyway, because crawling follows links first. The sitemap becomes genuinely useful when the site is large, recent, poor in inbound links, or rich in fresh pages you want to flag quickly.

The practical consequence, for a beginner, is reassuring: if your site builder generates a sitemap on its own, very good, declare it in Search Console and stop thinking about it. If it does not generate one and your site has ten well-linked pages, this is not your emergency.

The two mistakes that do more harm than having no sitemap

Declaring what you forbid. A sitemap that lists pages marked noindex, or blocked by robots.txt, sends two contradictory signals: “here are my pages” and “don’t touch them”. Google copes, but every contradiction erodes the trust it places in the file. The rule is simple: the sitemap lists only what you want to see on Google, in the expected format.

Lying about dates. The lastmod field indicates the page’s last real modification. Google uses it to decide what to revisit, and specifies that it only uses it if it is consistently verifiable. A site that stamps all its pages with today’s date, or worse, with a future date, teaches Google to ignore its dates. It is a common tooling defect, invisible to the eye, that neutralises precisely the service the sitemap was supposed to render, and it is the kind of thing that regular site maintenance exists to watch for.

So where does discovery come from, if not from the sitemap?

From links. Google repeats it in its guide: the vast majority of new pages are found by following a link from a page already known. The sitemap declares, the link gets crawled. Which means that the architecture of links inside your own site, the internal linking, weighs more than the XML file that accompanies it.

That is precisely the subject of the next part.

Who writes these notes

This journal is kept by the workshop that designs and maintains the house’s websites. Everything described here, the Search Console, internal links, the business profile, is part of the work delivered with a site: if you would rather someone took care of it, that is precisely the trade.

Design your site Write to us