URL Parameter & Crawl Trap Analyzer

Spot parameters that create endless URL variations, such as filters, sort orders, session IDs and tracking tags, before they waste crawl budget.

Use the tool

Why this tool exists

The tool counts every query parameter across your URLs, how many distinct values it takes, on how many paths it appears and what it probably does (tracking, session, sort, pagination or a filter). It also flags paths with many parameter combinations, URLs that differ only in parameter order, and drafts robots.txt rules for the parameters that are safe to block.

Blocking in robots.txt stops crawling but not indexing of known URLs, and it cuts link equity flow, so for facet filters that you want consolidated a canonical to the clean category is often better. The suggestions are a starting point to review.

No data is sent anywhere: the work happens in your browser, so you can use it offline once the page has loaded.

How to use it

  1. Export URLs from a crawl, a log file or Search Console and paste them one per line.
  2. Set the combination count at which a path is flagged.
  3. Read the parameter table and the crawl-trap list.
  4. Choose between canonical, noindex and robots.txt rules for each parameter.

Frequently asked questions

What is a crawl trap?

A set of URLs that is effectively infinite, such as combinable filters or calendars, so crawlers keep finding new pages with little value.

Should I block tracking parameters in robots.txt?

Usually no. Use a self-referencing canonical on the clean URL; blocking can hide the parameter from consolidation signals.

How are parameters classified?

By name patterns (utm_*, session ids, sort/order, page/offset) and by the number of distinct values; the labels are hints, not facts.

Is my data sent anywhere?

No. Everything is processed in your browser, and the page makes no network requests with your input.