Category: Developer tools

Robots Meta Tag Generator

System ideaMissing a tool?

Build a robots meta tag or X-Robots-Tag header from indexing options

Toggle index/noindex, follow/nofollow, archive, snippet, image indexing, translation and max-image-preview, and get both a <meta name="robots"> tag and the equivalent X-Robots-Tag response header. Built locally in your browser.

Meta tag
<meta name="robots" content="index, follow" />
X-Robots-Tag header
X-Robots-Tag: index, follow

Everything on this page is processed in your browser. Nothing is uploaded.

What this tool does

A page's robots meta tag or X-Robots-Tag header gives search engines page-level instructions that a robots.txt file can't: whether to index it, follow its links, keep a cached copy, show a text snippet or image preview in results, or offer a translation. The header form is useful for non-HTML files like PDFs, where there's no <head> to put a meta tag in. This tool builds both from the same set of toggles so they stay consistent.

How to use it

  1. Toggle indexing, following, archiving, snippets, translation and image indexing as needed.
  2. Pick a max image preview size.
  3. Copy the meta tag into your page's <head>, or the header line into your server config.

Privacy

This tool runs entirely in your browser. Your input is never uploaded, stored or shared — closing the tab removes it.

Frequently asked questions

Meta tag or X-Robots-Tag — which do I need?
Use the meta tag for HTML pages you can edit the <head> of. Use the X-Robots-Tag header for non-HTML files (PDFs, images) or when you'd rather control indexing from server config than markup — both accept the same directive values.
Does this override robots.txt?
They serve different purposes: robots.txt controls whether a crawler fetches a URL at all, while this tag controls what it does with a page it already fetched. A page blocked by robots.txt never gets far enough to see this tag.
Is anything sent to a server to build this?
No. The tag and header are assembled from your toggles directly in the browser.