Loading...
Loading...
Ready
Enter a domain on the left and run the test. Results stream in here.
Paste the page URL. We fetch the live HTML and read the full set of HTTP response headers.
We extract the <meta name="robots"> tag from the HTML and the X-Robots-Tag from the response headers, then split out every directive in each.
You get a clear verdict on whether the page is indexable and followable, plus warnings for any conflicting or accidental directives.
The meta robots tag is an HTML element placed in the <head> of a page that tells search engines how to handle that specific URL. Common directives include noindex (keep out of search results), nofollow (don't pass link equity from links on this page), noarchive, and nosnippet. Unlike robots.txt, which controls crawling, the meta robots tag controls indexing of pages the crawler has already fetched.
Robots.txt blocks crawling — Google never fetches the page, so it can't see a noindex directive inside it. The meta robots noindex requires the page to be crawlable so Google can read the tag and then drop it from the index. If you block a URL in robots.txt AND add a meta noindex, the noindex is never seen and the page can still appear (URL-only) in results. Use one or the other deliberately.
Directives like noindex and nofollow can be delivered two ways: as an HTML meta tag or as an X-Robots-Tag HTTP response header. The header is invisible in page source and commonly applied to non-HTML files (PDFs, images) or set globally by a CMS or CDN. A page can look fine in the HTML but still carry a header-level noindex, so we check both and flag conflicts.
Yes. Once Googlebot recrawls a previously indexed URL and sees a noindex directive, it drops the page from results, usually within days to a few weeks depending on crawl frequency. This is the correct way to deindex a page — but an accidental site-wide noindex (often shipped from a staging template) can wipe a site's organic traffic, which is why verifying it matters.
A page-level meta nofollow tells Google not to follow ANY links on that page and not to pass ranking signals through them. This is different from rel=nofollow on an individual link. Page-level nofollow is rarely needed today and can harm internal link flow if applied accidentally to important hub pages.
Yes. For a noindex (whether meta tag or X-Robots-Tag) to work, Googlebot must be able to crawl the page. If robots.txt disallows the URL, Google cannot fetch it, cannot read the noindex, and the URL may persist in the index as a 'blocked' result. Make sure pages you want deindexed are crawlable until they drop out, then you can block them.
Watch for nosnippet (prevents text snippets), noarchive (no cached copy), noimageindex (images excluded), max-snippet, max-image-preview, and unavailable_after (scheduled deindex). Some of these silently reduce how your page appears in SERPs and AI overviews even when the page is still indexed. This tool surfaces every directive it finds.