The Google Search Console Page Indexing report helps you understand which URLs Google has indexed, which known URLs are not indexed, and the reasons associated with those indexing states. Its most useful role is not simply identifying non-indexed pages. It helps you decide whether a URL actually needs fixing and which technical or editorial signal should be checked next.
That distinction matters because exclusion is not automatically an SEO problem. A thank-you page may be intentionally noindexed, a removed URL may correctly return a 404 response, and a duplicate URL may correctly resolve to another canonical version. The priority is to find important URLs that should be indexed but are not.
- Crawling and indexing are separate stages. Google can discover or crawl a URL without adding it to the index.
- Read each Page Indexing reason in context. A robots.txt block, noindex rule, duplicate URL and 404 response represent different situations and need different checks.
- Not every non-indexed URL needs fixing. First decide whether the URL should be available in Google Search.
- Use the Page Indexing report to identify patterns across the site, then use URL Inspection when an individual URL needs closer diagnosis.
- A sitemap supports URL discovery but does not force Google to crawl or index a page.
What the Page Indexing Report Actually Tells You
The Page Indexing report is Search Console’s site-level view of the indexing status of URLs Google knows about for your property. It separates indexed pages from URLs that are not indexed and groups affected URLs by the reason Google reports for that state.
Before interpreting those reasons, separate three stages of Google Search processing. Google first discovers URLs, then may crawl them, and later processes their content for possible indexing. Google does not guarantee that every discovered or crawled page will be indexed.
This is why a newly published URL can exist in a sitemap, receive internal links and even be crawled without immediately becoming searchable. Indexing is a separate decision. If a page remains outside Google’s index, on-page optimisation alone does not solve the problem until the underlying indexing state is understood.
For readers still learning the wider platform, MOCOBIN’s Google Search Console guide explains how indexing information fits alongside Search performance and other diagnostic reports.
Start With One Question: Should This URL Be Indexed?
The fastest way to waste time in the Page Indexing report is to assume that every non-indexed URL is an error. Before investigating the status label, decide what the URL is supposed to do.
A core service page, useful article, product page or important category page normally deserves investigation if it is unexpectedly absent from the index. An internal search result, tracking URL, duplicate filter, expired test page or private workflow page may not.
This changes the workflow. Instead of asking, “How do I get every URL indexed?”, ask, “Which important URLs are missing from the index, and why?” That keeps technical work focused on URLs with genuine search value.
Unexpected exclusions often come from a small group of technical signals. A robots.txt rule may prevent Googlebot from crawling a page. A noindex rule may explicitly tell Google not to show a crawlable page in Search. A canonical signal may indicate that another URL should represent a set of duplicates. A removed URL may simply return a valid 404 response.
These mechanisms are not interchangeable. In particular, robots.txt should not be treated as a reliable method for removing an HTML page from Google Search. Blocking crawling can also stop Google from seeing page-level directives such as noindex.
The Page Indexing report therefore belongs within broader technical SEO. It helps identify the indexing symptom, while robots directives, canonicals, internal links, HTTP responses and sitemap configuration help explain the cause.
How to Read Common Page Indexing Statuses
Do not treat every status as the same kind of exclusion. First identify the reason, then inspect representative URLs from that group and compare the reported state with what those URLs are supposed to do.
Page Indexing Status: What to Check First
| Status | What It Usually Means | Recommended First Check |
|---|---|---|
| Blocked by robots.txt | A robots.txt rule is preventing Googlebot from crawling the URL. | Check whether the crawl block is intentional. Do not assume robots.txt reliably prevents the URL itself from appearing in Search. |
| Excluded by ‘noindex’ tag | Google detected a noindex rule that tells it not to include the page in Search. | Confirm whether exclusion is intentional. If the page should be indexed, check the robots meta tag, X-Robots-Tag header and CMS or template settings. |
| Duplicate without user-selected canonical | Google considers the URL a duplicate and the site has not clearly declared a preferred canonical for that duplicate set. | Decide which URL should represent the content, then review canonical tags, internal links and sitemap consistency. |
| Discovered – currently not indexed | Google knows about the URL but has not crawled it yet. | Check how the URL is linked, whether it belongs in the sitemap, whether large numbers of low-value URLs are competing for crawl attention, and whether the site has broader crawl or server issues. |
| Crawled – currently not indexed | Google crawled the URL but has not added it to the index. | Review duplication, canonical signals, content usefulness, internal linking and whether the URL deserves a distinct role in Search. |
| Not found (404) | The requested URL returned a 404 response. | Decide whether the missing page should be restored, redirected to a genuinely relevant replacement, or left as a 404 because the content is intentionally gone. |
Duplicate and Canonical Statuses Need Context
A duplicate status is not automatically evidence of a technical failure. Websites commonly produce alternate URLs through parameters, filtering, tracking, print views or other variations. The important question is whether Google is selecting the URL you actually want to represent the content.
When duplicate URLs matter, review canonical signals together rather than relying on the canonical tag alone. Internal links should normally point to the preferred URL, and sitemap entries should also be consistent with the version you want Google to consider canonical.
Blocking duplicate URLs in robots.txt too early can make diagnosis harder because Google may be unable to crawl those pages and process their page-level signals.
Discovered and Crawled Are Not the Same Status
`Discovered – currently not indexed` and `Crawled – currently not indexed` require different first questions. In the first case, Google knows the URL but has not crawled it. In the second, Google has already fetched the page and still has not indexed it.
For a discovered URL, investigate discovery and crawl conditions first: internal links, crawl depth, sitemap inclusion, server health and large volumes of unnecessary URLs. For a crawled URL, the investigation can move further into duplication, canonicalisation, page value and whether the content has a sufficiently distinct purpose.
Understanding how crawling and indexing differ makes these statuses much easier to interpret.
Use URL Inspection for the Individual Page
The Page Indexing report is designed for finding patterns. If one commercially or editorially important URL needs investigation, switch to the URL Inspection tool.
URL Inspection can show information about Google’s indexed version of the URL, including indexing details and Google’s selected canonical when that information is available. It can also test the live URL to see whether the present version can be accessed and may be indexable.
Keep the indexed report and live test separate. If you corrected a noindex rule or other technical issue a few minutes ago, Google’s indexed data may still describe the older crawl. A live test can help confirm that the current page has changed, but passing a live test does not guarantee that Google will subsequently index the URL.
There is another important canonical limitation: the live test cannot predict which URL Google will ultimately select as canonical. Google’s selected canonical is based on indexed information and wider signals, not just the current canonical tag.
A practical page-level sequence is therefore:
- Confirm that the URL should be indexed.
- Check its reported Page Indexing reason.
- Inspect the specific URL in URL Inspection.
- Compare the indexed information with the current live page when a recent change has been made.
- Correct the underlying technical or content issue.
- Request indexing when appropriate, then allow Google time to recrawl and process the URL.
Requesting indexing is useful after a legitimate correction, but it is not a substitute for fixing duplication, crawl barriers, weak internal linking or conflicting canonical signals.
Common Diagnostic Mistakes
One common mistake is reporting a page as “indexed” merely because Googlebot crawled it. Crawling only means Google fetched the URL. Indexing is a later stage.
Another is trying to eliminate every 404 reported by Search Console. A genuine 404 can be the correct response for content that has been removed permanently and has no appropriate replacement. The priority is to repair broken internal routes and important missing URLs, not to make the report artificially empty. MOCOBIN’s guide to handling 404 errors explains that distinction in more detail.
A third mistake is using robots.txt and noindex as if they perform the same job. If you need Google to process a noindex rule, Google must be able to crawl the URL containing it. The guide to noindex and disallow rules covers this interaction in more depth.
How to Prioritise Indexing Problems at Site Level
Once you understand the status labels, prioritisation becomes more useful than simply counting excluded URLs. A site with thousands of intentionally excluded utility URLs may be healthier than a site with only a few exclusions if those few URLs include its most important service or product pages.
Start with page value. Core landing pages, important categories, products that should attract search demand and high-value editorial pages deserve attention when they are unexpectedly non-indexed. Low-value parameter combinations and deliberately excluded utility pages usually do not deserve the same urgency.
Then look for patterns. If one article is affected, inspect that URL. If hundreds of pages from the same template have the same unexpected reason, investigate the template, plugin, sitemap generator or deployment change that they share.
This pattern-based approach is particularly useful after migrations, CMS upgrades, SEO plugin changes, theme releases and large publishing updates. A single configuration mistake can alter robots directives, canonical tags, internal links or HTTP behaviour across an entire page type.
When the problem extends across several technical systems, move from Page Indexing diagnosis into a broader SEO audit workflow. Review crawlability, status codes, canonical URLs, sitemap entries, internal links and page-level directives as one system rather than correcting individual URLs in isolation.
Use Sitemaps as Evidence, Not as an Indexing Command
An XML sitemap is useful because it tells Google which URLs you consider important and helps with discovery, particularly on large, new or structurally complex sites. It does not guarantee that Google will crawl or index every submitted URL.
For indexing diagnosis, compare sitemap treatment with the rest of the page’s signals. An important canonical page should not simultaneously be submitted in the sitemap while carrying an unintended noindex rule or pointing to another canonical URL.
If a submitted page remains non-indexed, the sitemap itself is rarely a complete explanation. Check the reported Page Indexing reason, inspect the URL and then review the surrounding technical and editorial signals.
Monitor Changes, Not Just Totals
Page Indexing is most useful when monitored in context. A sudden increase in unexpected exclusions after a deployment is more informative than a fixed number of intentionally excluded URLs that has remained stable for months.
Record major technical releases and compare indexing changes with those dates. If a new theme, plugin, migration or template update coincides with an unexpected shift, investigate the affected page groups before making broad SEO changes elsewhere.
The practical objective is not to make every URL indexed. It is to maintain a clean relationship between the pages that deserve search visibility and the signals your website gives Google about those pages. Once that relationship is clear, the Page Indexing report becomes a decision tool rather than a list of errors.
- Google Search Console Help: Page indexing report
- Google Search Console Help: URL Inspection tool
- Google Search Central: How Google Search works
- Google Search Central: Introduction to robots.txt
- Google Search Central: Block Search indexing with noindex
- Google Search Central: Canonical URL guidance
- Google Search Central: Learn about sitemaps









