All articles

XML Sitemaps Explained: What to Include and What to Leave Out

Learn how to create an XML sitemap for SEO, which URLs belong in it, how to submit it in Search Console and how to avoid common sitemap mistakes.

An XML sitemap is a file that lists important URLs on your website so search engines can discover them more easily. It is particularly useful for new sites, large websites, or sites with pages that are not easy to reach through internal links. A sitemap is a hint—not a command—and including a URL does not guarantee that Google will crawl or index it.

For most small business websites, the best sitemap is simple: include the canonical, indexable pages you genuinely want people to find. Do not treat it as an inventory of every URL the website can generate.


TL;DR

- Include preferred, canonical URLs that return successfully and are intended to appear in search.
- Exclude redirected URLs, duplicates, error pages and pages marked noindex.
- Keep the sitemap updated when pages are added, removed or moved.
- Submit it in Search Console and investigate reported errors; submission alone does not guarantee indexing.

What does an XML sitemap do?

A sitemap gives search engines a structured list of URLs that you want them to consider discovering. It can be especially useful when a site has recently launched, when important pages sit deep in the navigation, or when a content archive has many URLs.

A sitemap does not replace crawlable internal links. A service page that matters to a business should also be discoverable through the site's normal navigation or contextual links. Google uses links to discover pages and understand how they relate to one another. If a valuable page only appears in a sitemap and nowhere else, review whether the site's architecture is making that page unnecessarily difficult to find.

Sitemaps can be generated by a CMS, a framework or a build process. The correct implementation depends on how your site is built. The objective is the same: the file should be accessible, valid and aligned with the site's preferred URLs.

What should you include in an XML sitemap?

1. Canonical service pages

Include your main service pages when they return a successful status, are indexable and represent the preferred URL. For a small service business, these may include distinct website design, SEO, local service or specialist offering pages—provided each page serves a real purpose.

2. Useful blog articles

Add original blog posts that are published, useful and intended to appear in search. Drafts, private preview pages or thin pages created only to target keyword variations should not be listed as if they were finished resources.

3. The preferred version of each URL

If multiple URLs show the same content, choose a canonical version and list that version. Do not include both HTTP and HTTPS versions, alternate hostnames or parameter-based duplicates as if they were distinct canonical pages.

4. Accurate modification dates where supported

If the sitemap includes lastmod, it should reflect a meaningful modification to the page, not be changed automatically simply to suggest that every URL is fresh. The value is most useful when it accurately communicates when the content was substantially updated.

What should you leave out?

Exclude pages that redirect to another URL, return 404 or 5xx errors, are blocked from indexing, or are duplicates of another preferred page. Search filters, internal search result URLs, session identifiers and utility endpoints usually do not belong in a basic sitemap unless there is a specific, well-understood reason.

Do not place a URL into a sitemap solely because you want Google to index it. First check whether it should exist as a public page at all. A sitemap full of duplicates, redirects and errors creates noise and makes diagnostics less useful.

Need help cleaning up your technical SEO?

The Super Shoppe's SEO & GEO service includes a site audit covering structure and metadata. It can help identify where your sitemap, canonical settings and important pages need attention.

Common XML sitemap mistakes

Mistake 1: Assuming submission guarantees indexing

Submitting a sitemap tells Google where to find URLs; it does not guarantee they will be crawled or included in results. If a page is missing from Search, inspect it with URL Inspection and check the reported indexing status.

Mistake 2: Listing every URL variant

A CMS may expose the same article at several URL variants. Choose the canonical URL, align internal links and redirects where appropriate, and include only the preferred version.

Mistake 3: Forgetting to update the sitemap after a redesign

If URLs change during a migration, update the sitemap to include the new destinations. Old URLs should be redirected when a relevant replacement exists, not left as the canonical entries in the new sitemap.

Mistake 4: Generating an inaccessible or invalid file

Open the sitemap URL in a browser, check for server errors and submit it through Search Console. For automatically generated sitemaps, check the production output after a deployment rather than assuming the development version proves the live file is correct.

Mistake 5: Using the sitemap instead of internal links

A sitemap is a discovery aid, not your site navigation. Link important pages from relevant pages using ordinary crawlable links and descriptive anchor text.

How to submit and maintain a sitemap

  1. Find the sitemap generated by your CMS or framework, often at a conventional path such as /sitemap.xml.
  2. Open it and confirm it returns a valid sitemap document rather than an HTML error page.
  3. Check that listed URLs use the correct domain, HTTPS and canonical paths.
  4. Submit the sitemap in Google Search Console's Sitemaps report.
  5. Review the report for fetch or parsing errors, and inspect important URLs separately if they are not indexed.
  6. Re-check the sitemap after major content changes, URL migrations or framework updates.

If the site contains only a modest number of pages, a simple sitemap can be enough. Larger sites may need sitemap indexes or separate sitemaps by content type. Use the structure appropriate to the site rather than adding complexity for its own sake.

How The Super Shoppe can help

The Super Shoppe supports businesses with website development and technical SEO. Explore SEO & GEO services for help reviewing indexability, metadata and site structure, or view our website service if your current build makes basic SEO maintenance difficult.

Sources

Frequently asked questions

Not every small site will depend heavily on one, but a sitemap is generally a useful, low-maintenance way to tell search engines about preferred URLs. It is especially helpful for new sites and sites with many pages.

Usually not. A sitemap should generally list canonical URLs intended for indexing, not pages explicitly excluded from search.

It should update when the set of important URLs changes. Automated sitemap generation is usually simpler and less error-prone for sites that publish regularly.

More articles