Cookies disclaimer

I agree Our site saves small pieces of text information (cookies) on your device in order to deliver better content and for statistical purposes. You can disable the usage of cookies by changing the settings of your browser. By browsing our website without changing the browser settings you grant us permission to store that information on your device.

Indexable Data

Indexable

Indexable
Returned Values
Indexable Resources
Example of How Indexable Data is Used
- Example 1: Quickly Find Your Indexable Resources
Related Content
Benefits of Our Data

 

Indexable

HTML/Text pages that are not restricted by a robots.txt or meta robots tag from being indexed and have a status code of 200. Indexable content has at least the potential to appear in Google’s SERPs (Search Engine Results Page). How well it ranks within the SERPs is another matter, but a page has o be indexed to appear in them.

 

Returned Values

Within the column for ‘Indexable’, the two options or the values we would return in the fields / cells are as follows:

True

Indexable

False

Non-Indexable

 

Indexable Resources

This is a valuable check and a great time saver! We check every page for these five things where present, if they are, then the resource is deemed indexable:

  • Is the URL allowed to be crawled by the robots.txt?
  • The URL does not contain the NOINDEX tag
  • The URL returns a status code of ‘200’
  • If the URL has a canonical tag, is self-referential?
  • URL contains at least 1 internal link from and indexable page

This performs a technical assessment of whether a page is technically indexable by Google, not whether it is in fact indexed. There may be external factors such as a penalty that are preventing a page from being indexed that this assessment does not include.

 

Example of How Indexable Data is Used

There are various reasons why you would want to look at Meta Robots Data, we have set out some examples below.

 

Example 1: Quickly Find Your Indexable Resources

Filtering for ‘true’ within the ‘indexable’ column will show you are resources that are indexable. When used with other data such as HTML/Text pages, Canonical Pages, etc, you can easily identify the main pages of the website you likely to want to optimise.

 

Related Content

The list of guides below might be useful if you are analysing this data and want to know more about it:

Related column headers in Raptor website crawler reports:

 

Benefits of Our Data

There are several benefits to analysing indexation data, such as those listed below:

  • Identify Indexation Issues for SEO
  • Identify all indexable Resources
  • Identify all non-indexable Resources
  • Resolve indexation issues & conflicts
  • Audit a site’s indexation profile
  • Scrape competitor indexation data

 

Sign up Today for a Free 30-Day Trial. Identify indexation Issues on your site!