robots.txt Sitemap Line Extractor and Checker
Pulls out the Sitemap lines from a robots.txt and checks them.
Use the tool
Why this tool exists
Sitemap lines must be absolute URLs. A relative path, a typo or an old http address is ignored or points crawlers to the wrong place.
The extractor lists each Sitemap line with its line number, flags relative URLs, duplicates, unusual file extensions and mixed http and https, and prints a plain list you can copy.
How to use it
- Paste the robots.txt.
- Review the table of Sitemap lines.
- Fix relative or duplicate entries.
- Validate each sitemap with the sitemap validator.
Frequently asked questions
Are Sitemap lines tied to a user-agent?
No. They apply to the whole file wherever they are placed.
Can Sitemap be a relative path?
No, it must be a full URL.
Can I list several sitemaps?
Yes, one per line.
Does it open the sitemaps?
No, it makes no network requests. Paste a sitemap into the sitemap validator.