Crawling Errors vs. Indexing Errors

Why this matters

Conflating crawling errors with indexing errors leads to wrong fixes — a 404 is a crawl error (the server rejected the request) while a 'Duplicate without canonical' is an indexing error (the server responded fine but Google chose not to index it). Diagnosing the right layer determines whether you fix your server configuration, your canonical tags, or your content quality.

Try it yourself

1. In Google Search Console, open Index → Pages and map each exclusion reason listed to either 'crawl error' (server or DNS-level failure) or 'indexing error' (Google's decision not to index a successfully fetched page) — create a two-column table.
2. Pick one URL from the 'Soft 404' bucket in your Coverage report and fetch it manually with curl -o /dev/null -w '%{http_code}' https://yourpage — confirm the HTTP status is 200, then explain why Google classified it as a soft 404 despite the 200 response.
3. Find one page with a 'Redirect error' in Search Console and trace the full redirect chain using curl -IL https://yoururl — identify whether the final destination is the canonical version you intended.

References

• Google Search Console Help — Fix Indexing Problems