Robots Meta Tag Generator

Control how search engines index a page. Choose index or noindex, follow or nofollow, and options like noarchive, nosnippet and image preview size, and get the robots meta tag, the X-Robots-Tag header for PDFs and other files, and server config — with warnings for combinations that don't work.

Common directives

DirectiveEffect
noindexExclude from results
nofollowDon't follow links
nosnippetNo text snippet
max-image-preview:largeAllow large images
noarchiveNo cached copy

When to use it

  1. Keep staging, thank-you or internal pages out of search.
  2. Allow large image previews in Discover.
  3. Stop PDFs from being indexed via headers.
  4. Remove an event page after a date.

How to Use

  1. Choose indexing, link and snippet options.
  2. Pick which crawlers it applies to.
  3. Copy the meta tag or header.

Features

  1. All standard directives
  2. Crawler-specific tags
  3. X-Robots-Tag header
  4. Nginx and Apache config
  5. Conflict warnings

FAQs

What's the difference between noindex and robots.txt?

robots.txt stops crawling; noindex removes a page from results — and only works if the page can be crawled.

How do I noindex a PDF?

Send the X-Robots-Tag: noindex header for that file.

Do I need index, follow?

No — that's the default.

What does max-image-preview:large do?

Allows large image previews, which can help visibility in Google Discover.

Can I target only Google?

Yes — choose Googlebot.

Technical Details

The directives are combined into one comma-separated value: - index or noindex, and follow or nofollow. - noarchive, nosnippet, noimageindex and notranslate. - max-snippet:n, max-image-preview:none, standard or large, and max-video-preview:n. - unavailable_after, written as an ISO date-time. The value can target all robots or a named crawler such as googlebot or bingbot. It's emitted as a meta tag for HTML, an X-Robots-Tag header for any file type (the crawler name is prefixed when specific), and Nginx and Apache configuration lines. Conflicts are flagged: snippet settings do nothing under noindex, nosnippet overrides max-snippet, index-follow alone is the default, and a noindexed URL must not be blocked in robots.txt or crawlers never see the directive.

SEO Tools

SEO Tools

  • Sitemap Inspector
  • Robots.txt Generator
  • Keyword Density Checker
  • SERP Snippet Checker
  • Hreflang Generator
  • Meta Tags Analyzer
  • Open Graph Checker
  • ads.txt Generator