Home All Checks Start Audit

Meta Robots Checker

Check whether the page is blocked from indexing via meta robots tags or X-Robots-Tag header

Check Results

This only checks indexing directives. For a comprehensive analysis, use the full page check.

You can also audit your entire site. Duplicate titles and descriptions, orphan pages, broken links between sections, and other site-wide issues can only be found with a full site audit.

If you don't have an SEO specialist, we can help fix the errors found.

Full Page Check Full Site Audit Fix Errors

Why Check Indexing Directives

The meta robots tag and X-Robots-Tag HTTP header control how search engines process the page. Incorrect configuration can completely exclude the page from search results.

What This Tool Checks

  • Meta robots tag — presence of noindex, nofollow, none, noarchive directives
  • Googlebot meta tag — separate rules for Google
  • Bot-specific meta tags — separate rules for specific crawlers
  • X-Robots-Tag HTTP header — server-side equivalent of the meta robots tag

Main Directives

  • noindex — prevents page indexing
  • nofollow — prevents following links on the page
  • none — combination of noindex and nofollow
  • noarchive — prevents saving a cached copy

Common Mistakes

  • noindex left after testing — page doesn't appear in search
  • CMS automatically added noindex to important pages
  • X-Robots-Tag on the server overrides meta tags in HTML
  • Different rules for Googlebot and other bots without necessity

Frequently Asked Questions

What's the difference between robots.txt and the meta robots tag? ▶
robots.txt controls crawler access to the entire site or its sections. The meta robots tag controls indexing of a specific page. A page can be accessible to crawlers (not blocked in robots.txt) but still excluded from indexing via noindex.
Which takes priority — meta tag or X-Robots-Tag? ▶
If both are specified and conflict, the search engine typically applies the stricter rule. For example, if the meta tag allows indexing but X-Robots-Tag forbids it, the page won't be indexed.
How quickly does noindex take effect? ▶
After adding noindex, the page will be excluded from search results on the next crawl. This can take anywhere from a few days to a few weeks depending on how often your site is crawled.

Other Checks

Indexing Check
robots.txt Check
sitemap.xml Check
SSL Certificate Check
HTTP/HTTPS Check
www Redirect Check
Title Tag Check
Meta Description Check
Headings Check
Canonical Check
Viewport Check
Open Graph Check
Encoding Check
Image Format Check
Alt Tags Check
Lazy Loading Check
Internal Links Check
External Links Check
Broken Links Check
Structured Data Check
Compression Check
HTML Size Check
Render-blocking JS Check
Mixed Content Check
HSTS Check
URL Structure Check