robots.txt Sitemap Line Extractor and Checker

Pulls out the Sitemap lines from a robots.txt and checks them.

Use the tool

Why this tool exists

Sitemap lines must be absolute URLs. A relative path, a typo or an old http address is ignored or points crawlers to the wrong place.

The extractor lists each Sitemap line with its line number, flags relative URLs, duplicates, unusual file extensions and mixed http and https, and prints a plain list you can copy.

How to use it

  1. Paste the robots.txt.
  2. Review the table of Sitemap lines.
  3. Fix relative or duplicate entries.
  4. Validate each sitemap with the sitemap validator.

Frequently asked questions

Are Sitemap lines tied to a user-agent?

No. They apply to the whole file wherever they are placed.

Can Sitemap be a relative path?

No, it must be a full URL.

Can I list several sitemaps?

Yes, one per line.

Does it open the sitemaps?

No, it makes no network requests. Paste a sitemap into the sitemap validator.