robots.txt Wildcard Pattern Tester (* and $)

Shows which of your sample URLs a robots.txt pattern matches, in plain words and as a regular expression.

Use the tool

Why this tool exists

Only two special characters exist in robots.txt: * matches any run of characters and $ marks the end of the URL. Even so, patterns like /*.pdf$ or /*?sort= surprise people, because matching starts at the path, includes the query string and is case sensitive.

Paste patterns and URLs and see exactly what each one catches. The tool does not decide Allow against Disallow; use the tester for the full verdict.

How to use it

  1. Paste patterns, one per line (with or without the Allow or Disallow prefix).
  2. Paste sample URLs.
  3. Read MATCH or no match for each pair.
  4. Adjust the pattern until it catches only what you want.

Frequently asked questions

Does the pattern match the query string?

Yes. The path and query string are matched together, which is why /*?sort= works.

What does $ do?

It anchors the pattern to the end of the URL, so /*.pdf$ matches a.pdf but not a.pdf?x=1.

Is matching case sensitive?

Yes. /Admin and /admin are different.

Does it test Allow against Disallow?

No, it tests one pattern at a time. The robots.txt tester resolves conflicts.