GSC Index Coverage Report: Fix Crawl Errors and Get More Pages Indexed

The Four Index Coverage Statuses

Google Search Console categorizes every URL it discovers into one of four states. Understanding each one is the foundation of technical SEO diagnostics.

Error

These pages failed to index. Google tried but hit a blocking issue. Common errors:

• Submitted URL not found (404) - The URL is in your sitemap but returns a 404. Either the page was deleted, the URL changed, or there's a typo in your sitemap. Fix: redirect the old URL to the new one, or remove it from your sitemap.
• Server error (5xx) - Googlebot hit your server and got a 500, 502, 503, or 504 response. Could be intermittent downtime or a specific page bug. Fix: check your server logs for that URL, reproduce the error, fix the underlying cause.
• Redirect error - A redirect loop, a chain that's too long (5+ hops), or a redirect to a blocked URL. Fix: audit your redirect chains with Screaming Frog and ensure every redirect resolves in 1-2 hops.

Valid With Warning

These pages are indexed, but something is technically off. The most common warning:

• Indexed, though blocked by robots.txt - Google crawled and indexed the page despite your robots.txt trying to block it. Important nuance: robots.txt blocks crawling, but if another site links to the page, Google can still index it from the link. Fix: if you don't want the page indexed, add a <meta name="robots" content="noindex"> tag. If you do want it indexed, remove the disallow rule.

Valid

Healthy, properly indexed pages. This is your goal state for all important URLs.

Excluded

Not indexed, but with varying degrees of intentionality:

• Excluded by noindex tag - You explicitly told Google not to index it. This is correct for thank-you pages, admin pages, duplicate content pages.
• Alternate page with proper canonical tag - You have duplicate URLs (e.g., with and without trailing slash) and the canonical points to the correct one. This is expected and healthy.
• Blocked by robots.txt - Crawling is blocked. Google may have discovered the URL via a link but respects the crawl block.
• Soft 404 - The page returns a 200 HTTP status but the content signals it's empty or missing (e.g., a search results page with no results, or a product page that says "This item is unavailable"). Fix: return a proper 404 status code, or add meaningful content.
• Discovered - currently not indexed - Google found the URL but hasn't prioritized crawling it yet. This often happens with large sites or low page authority. Fix: add internal links to these pages from high-authority pages on your site, and submit via URL Inspection → Request Indexing.

How to Request Indexing

For individual important pages:

1. Open URL Inspection in GSC
2. Enter the URL
3. If it shows "URL is not on Google", click "Request Indexing"
4. Wait 24-72 hours, then recheck

For bulk submissions, ensure your sitemap is up-to-date and submit it under Sitemaps. GSC will crawl it during the next scheduled crawl.

URL Inspection → Live Test Flow

Before requesting indexing, always run the Live Test:

1. URL Inspection → enter URL
2. Click "Test Live URL"
3. Check the rendered HTML - does your content appear? JavaScript-rendered content may not be visible if the render fails
4. Check for HTTP status, canonical URL, page fetch status, and mobile usability

If the Live Test shows your content but the page is still excluded, the issue is likely authority or crawl budget, not a technical block.

Links: Index Coverage report documentation | Fix search coverage issues