🤖 Meta Robots Checker
Check meta robots directives and HTTP X-Robots-Tag. Detect noindex, nofollow, and conflicts between HTML and HTTP-level directives.
Check Robots Directives
About the Meta Robots Checker
This tool analyzes all robots directives affecting a page — from meta tags in the HTML to X-Robots-Tag HTTP headers. It detects conflicts, highlights Googlebot-specific rules, and gives a clear pass/warning/fail assessment.
Common Robots Directives
- noindex — Do not show this page in search results
- nofollow — Do not follow links on this page
- noarchive — Do not show a cached copy
- nosnippet — Do not show a text snippet or video preview
- max-snippet:N — Limit snippet to N characters
- max-image-preview:N — Control image preview size (none/standard/large)
- none — Equivalent to noindex, nofollow
Why Conflicts Matter
If your HTML says index, follow but your server sends X-Robots-Tag: noindex, the page will not be indexed. The most restrictive directive wins. This tool helps you catch these issues before they hurt your rankings.
Frequently Asked Questions
What are meta robots directives?
Meta robots tags (and X-Robots-Tag HTTP headers) tell search engines how to handle your page. Common directives include noindex (don't index), nofollow (don't follow links), noarchive (don't cache), nosnippet (don't show snippets), and max-snippet/max-image-preview restrictions.
What happens if HTML and HTTP robots directives conflict?
When both meta robots (HTML) and X-Robots-Tag (HTTP header) are present, the most restrictive directive typically wins. For example, if one says "index" and the other says "noindex", the page will not be indexed.
How do I check if Googlebot sees different robots rules?
This tool checks both the standard meta robots tag for all bots and the googlebot-specific meta tag. Some sites serve different rules to Google specifically.