Why pages aren't indexed in Google Search Console
Every reason in Search Console's page indexing report, in Google's words: what each means, which to leave alone, and how to fix the ones that cost traffic.
Excluded by ‘noindex’ tag: where it came from and how to undo it
Search Console says pages are excluded by a noindex tag. Read the live directive, trace it to the CMS, template, server or CDN, and get the pages back.
Excluded by ‘noindex’ tag
Blocked by robots.txt, and indexed though blocked
What the two robots.txt statuses in Search Console mean, how Google reads the file line by line, and how to unblock a page or keep it out of Google properly.
Blocked by robots.txt
Sitemap “Couldn’t fetch” and the other sitemap errors
Why Search Console can't fetch or read a sitemap: a wrong URL, robots.txt, redirects, HTML instead of XML, size limits, and the failures that still answer 200.
Couldn't fetch
Traffic dropped after a redesign: what to check, in order
A redesign that loses search traffic usually broke something you can test: a noindex, a robots.txt rule, missing redirects, rewritten titles or a dead sitemap.
Page with redirect
Duplicate title tags: which ones cost you traffic
What Google does when pages share a title, when duplicates are harmless, how to find template defaults in a crawl export, and how to rewrite titles safely.
Every reason in the report
In Search Console under Indexing, then Pages, in the table “Why pages aren't indexed”. Each one in Google's words, with what to do about it.
Blocked by a rule on your site
A directive or a login told Google to stay out. That is right for a cart page and wrong for a product page.
- Depends on the page
Excluded by ‘noindex’ tag
On Google's help page: URL marked ‘noindex’
“When Google tried to index the page it encountered a 'noindex' directive and therefore did not index it.”
Fix it when the page should rank. The directive is a robots meta tag or an
Find what added the noindexX-Robots-Tagheader, added by a CMS setting, a template, the server or the CDN. - Depends on the page
Blocked by robots.txt
On Google's help page: URL blocked by robots.txt
“This page was blocked by your site's robots.txt file.”
Fix it when the page should rank: find the
Find the line that blocks itDisallowrule that matches the URL. robots.txt stops crawling, not indexing, so don't use it to hide a page. - Depends on the page
Blocked due to unauthorized request (401)
“The page was blocked to Googlebot by a request for authorization (401 response).”
Right for a staging site or a members' area behind a login. If the page is meant to be public, remove the authentication from that path.
- Fix it
Blocked due to access forbidden (403)
“HTTP 403 means that the user agent provided credentials, but was not granted access.”
On a public page this is often bot protection or a firewall rule answering Googlebot with 403. Check the security rules for anything that matches crawlers, and test the URL with the URL Inspection live test.
The URL didn't answer properly
Most of these are worth fixing for any URL people still reach.
- Fix it
Server error (5xx)
“Your server returned a 500-level error when the page was requested.”
Look in the server or hosting logs for Googlebot's requests at the time of the crawl. Errors that come and go under load still count.
Status code checks - Fix it
Redirect error
“Google experienced one of the following redirect errors:”
Google lists a chain that is too long, a loop, a URL that exceeds the maximum length, and a bad or empty URL in the chain. Point every old URL straight at its final address.
Check a redirect map - Depends on the page
Not found (404)
“This page returned a 404 error when requested.”
A 404 for a page that no longer exists is correct. Redirect it when the URL had traffic or links and an equivalent page exists. A migration that leaves old URLs on 404 is the case to fix.
After a redesign or migration - Fix it
Soft 404
“The page request returns what we think is a soft 404 response.”
The page answers 200 but looks empty or missing to Google. Return a real 404 or 410 for pages that are gone. Google also warns that redirecting many old URLs to one unrelated page, such as the home page, can be treated as a soft 404.
Redirects that look like soft 404s - Fix it
URL blocked due to other 4xx issue
“The server encountered a 4xx error not covered by any other issue type described here.”
Inspect the URL to see the exact code, then treat it like the ones above. A 410 for a page you removed on purpose is fine.
Duplicates, canonicals and redirects
Google indexed a different URL for the same content. Usually fine. Worth a look when Google's choice is not yours.
- Leave it
Alternate page with proper canonical tag
“This page correctly points to the canonical page, which is indexed, so there is nothing you need to do.”
Google's own words. This is the canonical tag working as intended.
- Leave it
Page with redirect
“This is a non-canonical URL that redirects to another page. As such, this URL will not be indexed.”
Expected for every URL that redirects. Update internal links and the sitemap to the final URLs, so Google spends less time on the redirects.
Redirects after a redesign - Depends on the page
Duplicate without user-selected canonical
“This page is a duplicate of another page, although it doesn't indicate a preferred canonical page.”
Add a canonical tag on the version you want indexed, or redirect the duplicates to it. Often caused by URL parameters, trailing slashes, or
Check a page's canonicalwwwand non-wwwboth answering. - Depends on the page
Duplicate, Google chose different canonical than user
“Google has indexed the page that we consider canonical rather than this one.”
Your canonical tag is a hint, and Google picked another URL. Make the other signals agree with your choice: internal links, the sitemap and redirects should all point at the URL you named.
Check a page's canonical
Google's own decision
No error on your side. Google found the page and chose not to index it yet, or at all.
- Depends on the page
Crawled - currently not indexed
“The page was crawled by Google but not indexed. It may or may not be indexed in the future; no need to resubmit this URL for crawling.”
Not a technical fault, so there is no switch to flip. If the page should rank, make it more useful than the pages that do, and link to it from pages that are indexed. Google says resubmitting it does not help.
- Depends on the page
Discovered - currently not indexed
“The page was found by Google, but not crawled yet.”
Usually a matter of waiting. If it lasts for weeks and covers pages that matter, link to them from pages Google already crawls and list them in the sitemap. That advice comes from practice, not from the help page.
Make sure the sitemap is read
Indexed, with a warning
These pages are in Google. The report lists them under Improve page experience because something is off.
- Depends on the page
Indexed, though blocked by robots.txt
“The page was indexed despite being blocked by your website's robots.txt file.”
Google indexed the URL from links without crawling it. To keep it out, allow crawling and add a noindex. To have it indexed properly, remove the
Indexed, though blockedDisallowrule. - Fix it
Page indexed without content
“This page appears in the Google index, but for some reason Google could not read the content.”
Run the URL Inspection live test and look at what Google actually received. An empty response, a block page from a firewall, or content Google can't render are the causes to rule out first.
Questions
Not on its own. Google doesn't index every URL it finds, and several reasons in this report are the site working as intended: redirects, alternates with a proper canonical, carts and account pages with a noindex. Look at the reasons for pages that should rank, and leave the rest.
After you fix an issue, Validate fix asks Google to re-check the URLs listed under it. Google's help page says validation “typically takes up to about two weeks, but in some cases can take much longer”, and asks you not to click it again until it has passed or failed.
The report shows what Google saw on its last crawl of each URL. Until the URL is crawled again, the old reason stays. The URL Inspection live test fetches the page now, which is how to confirm the fix before Google catches up.
Search Console and its help page don't always use the same words. The report says “Excluded by ‘noindex’ tag” where the help page says “URL marked ‘noindex’”, and “Blocked by robots.txt” where the help page says “URL blocked by robots.txt”. The meaning is the same.
The ones that come from your site: a noindex in the tag or the header, robots.txt rules that block pages, 4xx and 5xx responses, redirects, canonicals that point elsewhere and broken sitemaps. It can't see Google's own decisions, such as “Crawled - currently not indexed”, because those only exist inside Google.
Google's explanations are quoted from Page indexing report, Search Console Help, checked on 3 November 2026.
See the problems on your side before they reach this report
SEOtto flags noindex tags, robots.txt blocks, errors, redirects and broken sitemaps on the next crawl of your site. One site is free.