robots.txt Blocked CSS, JS and Image Checker

Tests your resource URLs, or a set of common paths, against robots.txt for a chosen crawler and lists blocked ones.

Use the tool

Why this tool exists

Google renders pages, so it needs the CSS and JavaScript they load. Old advice to disallow /assets/ or /wp-includes/ can leave the crawler with a broken-looking page.

Paste your robots.txt and your resource URLs, or leave the list empty to test typical paths. The tool lists blocked resources with the deciding rule and flags Disallow rules that look like they cover page resources. These are items to review; the URL Inspection tool in Search Console shows what was really fetched.

How to use it

  1. Paste the robots.txt.
  2. Paste your resource URLs, or leave empty for common paths.
  3. Choose the crawler.
  4. Fix or add Allow rules for blocked resources.

Frequently asked questions

Why does blocking CSS and JS matter?

Without them a rendering crawler may see an unstyled or incomplete page and judge it poorly.

Do I need to unblock images?

Only if you want them in image search or they are part of the page layout.

Are the default paths my real files?

No, they are typical examples. Use your own URLs for a real answer.

Is this a verdict?

No. Treat results as review items.