robots.noindex
Robots meta tag with noindex, or an X-Robots-Tag header. Level: Warning.
When it is raised
Raised when the first meta tag named robots that has a content attribute, in the first 300,000 characters of the HTML, outside comments, contains the word noindex (case-insensitive). The tag may use name or property, matched case-insensitively. Only that first robots tag is read, so a later robots tag containing noindex is ignored, including when the first tag's content is empty or whitespace. It is also raised when the response the API read the page from, after redirects, carries an X-Robots-Tag header with any non-empty value, including values other than noindex. The message names the source: the meta tag, the header, or both.
What it does to a shared link
noindex in a robots meta tag or an X-Robots-Tag header is an instruction not to add the page to a search index. An X-Robots-Tag header is set by the server and does not appear in the page's HTML.
How to fix it
- If the page is meant to be indexed, remove noindex from every robots meta tag, or remove those tags.
- If the header is the source, remove the X-Robots-Tag header from the page's response in the server or CDN configuration.
- If the page is deliberately excluded from indexing, no change is needed.