Cookies disclaimer

I agree Our site saves small pieces of text information (cookies) on your device in order to deliver better content and for statistical purposes. You can disable the usage of cookies by changing the settings of your browser. By browsing our website without changing the browser settings you grant us permission to store that information on your device.

Has meta robots index Data

Has Meta Robots Index

Has Meta Robots Index
Values Returned
Examples of How Meta Robots Data is Used
- Example 1: Check for Consistency
- Example 2: Identifying Indexation Issues
What We Do & What We Give You
Related Content
Benefits of Our Data

 

Has Meta Robots Index

If the page has a the meta robots tag with an 'Index' attribute specified.

 

Values Returned

Within the column for ‘Has meta robots index’, the two options or the values we would return in the fields / cells are as follows:

True

There is a meta robots tag present and it has the ‘index’ attribute

N/A

No Meta Robots Tag present on URL

False

There is a meta robots tag present, but it does not have the ‘index’ attribute

 

Examples of How Meta Robots Data is Used

There are various reasons why you would want to look at Meta Robots Data, we have set out some examples below.

 

Example 1: Check for Consistency

Using this data can help you to identify if these tags are consistently applied throughout a site.

 

Example 2: Identifying Indexation Issues

If a page is not indexed, you may want to look at this tag to see if it could be contributing to or causing a problem or to rule it out as a potential cause.

 

What We Do & What We Give You

We analyse meta robots tags (see example highlighted below) and look specifically for the ‘index’ attribute.

  • <meta name=”robots” content=”index, follow”>

If the page contains this tag regardless of whether the tag is implemented correctly, we will mark the field as ‘true’. If the tag is set to anything else or is not used, the field will be empty.

 

Related Content

The list of guides below might be useful if you are analysing this data and want to know more about it:

Related column headers in Raptor website crawler reports:

 

Benefits of Our Data

There are several benefits to analysing indexation data, such as those listed below:

  • Identify Indexation Issues for SEO
  • Identify all index meta robots
  • Resolve indexation issues & conflicts
  • Audit a site’s indexation profile
  • Scrape competitor indexation data

 

Sign up Today for a Free 30-Day Trial. Identify indexation Issues on your site!