The indexation data section of the summary tab (found under the reporting section of our SEO tool) provides you with various summarised data about the indexability of your site’s URLs. The summary tab is designed to provide an overview of the crawl data that we analyse after the crawl. The indexation section shows data that will affect whether pages can be indexed or accessed.
The video below shows you how to use this data and some of the functionality that is included within the data summary tab.
What Is Indexation?
Indexation is the process that search engines go through to collect web content and store this in an ‘index’ that allows them to present search results. This is why this data is so important, pages that cannot be indexed will not appear in the search results.
The screenshot below shows what the indexation data looks like within the summary tab:
The visual error indicators are shown in the screenshot below, in this section they are either blue which indicates informational data or red which indicates a serious error:
Compare Indexation Data
Our SEO crawl data can be compared on the summary tab easily by selecting the crawl date from the drop-down menu at the top of the summary table. This means that you can compare the indexability of your site over time.
Identify Indexation issues
This feature is especially useful if you have recently made sitewide changes such as a redesign or a website migration. After such a sitewide change it is possible for tabs such as noindex tags and disallows to remain in place. Comparing the difference between two crawls (pre and post site change) allows you to quickly identify indexation problems.
What Summary Indexation Data Do We Show?
We show the following indexation data within the summary tab our tool:
Noindex tags are rel attributes that prevent a page from being indexed by Google. The data in this category shows you which pages contain this tag. These pages will not appear in Google’s search results.
Read more about noindex tags.
Disallowed URLs are URLs that are disallowed from the robots.txt which means that these pages will not be crawled by Google. Pages that are not crawlable will not be indexed and consequently will not appear in the search results.
Read more about Disallowed URLs.
These are URLs that redirect to another URL, there is nothing intrinsically wrong with having a redirect in fact there are many reasons why you need to redirect a page. However, any page that is redirected will not be indexed by Google because they are not accessible.
Read more about 3XX Pages.
These URLs are not accessible due to an error, these are many types of 4XX error, and we cover each of these in more detail in the guide linked below. Inaccessible URLs like these will also not be indexed by Google and will not appear within the search results.
Read more about 4XX Pages.
500 errors are server response codes that mean a page or URL is not accessible, like all inaccessible pages these URLs will not be indexed and hence will not appear within the search results of Google. There are many 500 error status codes, each of which are covered in more depth in the guide linked below.
Read more about 5XX Pages.