# CrawlCoach

> CrawlCoach checks the pages in a site's sitemap against Google's own data. It shows which pages Google skipped, explains why, and gives the fix for each reason.

CrawlCoach connects to Google Search Console with one Google sign-in. It reads Google's URL Inspection data for the pages in the site's sitemaps, sorts the skipped pages by the reason Search Console gives, and explains each reason with its fix. Paid plans check pages every day, resubmit sitemaps when pages change, and send a fix list with the steps for each page. Pro and Agency also write new titles and descriptions.

CrawlCoach does not use Google's Indexing API, which Google only allows for job posts and livestream videos. No tool can force Google to index a page. Google makes the final call on what it indexes.

- Free report, before any plan: a one-time index health report for up to 500 URLs. No card.
- Starter, $29 a month. 1 site, up to 2,000 pages. Your site checked every day. An email when a page drops off Google. A monthly fix list with the top fixes for your missing pages. Bing and Microsoft Copilot checks: the pages Bing has not crawled.
- Pro, $59 a month. Everything in Starter, for up to 3 sites. Up to 25,000 pages per site. Traffic wins every week: pages just off page 1, and pages people see but rarely click. New titles and descriptions, written for you. New pages, and pages Bing has not crawled, sent to Bing for you.
- Agency, $149 a month. Everything in Pro, for 15 sites. Up to 50,000 pages per site. A report for each client, as a link or PDF. No CrawlCoach branding on client reports.

## Indexing reasons

- [Submitted and indexed](https://crawlcoach.com/reasons/submitted-and-indexed): The page is on Google, and it is in your sitemap.
- [Indexed, not submitted in sitemap](https://crawlcoach.com/reasons/indexed-not-submitted-in-sitemap): The page is on Google, but it is missing from your sitemap.
- [Crawled - currently not indexed](https://crawlcoach.com/reasons/crawled-currently-not-indexed): Google visited the page and chose not to show it in search, usually because the page added too little.
- [Discovered - currently not indexed](https://crawlcoach.com/reasons/discovered-currently-not-indexed): Google knows the page exists but has not visited it yet.
- [Duplicate without user-selected canonical](https://crawlcoach.com/reasons/duplicate-without-user-selected-canonical): Google sees the page as a copy of another page, and the page doesn't say which one is the main page.
- [Duplicate, Google chose different canonical than user](https://crawlcoach.com/reasons/duplicate-google-chose-different-canonical): Your page says it is the main page, but Google picked a different page.
- [URL is unknown to Google](https://crawlcoach.com/reasons/url-is-unknown-to-google): Google has not found this page anywhere yet.
- [Soft 404](https://crawlcoach.com/reasons/soft-404): The page loads, but Google thinks it looks like an error or an empty page.
- [Page indexed without content](https://crawlcoach.com/reasons/page-indexed-without-content): Google added the page to search but could not read what is on it.
- [Excluded by 'noindex' tag](https://crawlcoach.com/reasons/excluded-by-noindex-tag): A noindex rule on the page tells Google to leave it out.
- [Blocked by robots.txt](https://crawlcoach.com/reasons/blocked-by-robots-txt): Your robots.txt file stops Google from visiting the page.
- [Indexed, though blocked by robots.txt](https://crawlcoach.com/reasons/indexed-though-blocked-by-robots-txt): Google lists the page because of links, but robots.txt stops Google from reading it.
- [Alternate page with proper canonical tag](https://crawlcoach.com/reasons/alternate-page-with-proper-canonical-tag): The page says another page is the main one, and Google agrees.
- [Page with redirect](https://crawlcoach.com/reasons/page-with-redirect): The page sends visitors to another page, so Google shows that one instead.
- [Not found (404)](https://crawlcoach.com/reasons/not-found-404): The page shows a 404 Not Found error.
- [Server error (5xx)](https://crawlcoach.com/reasons/server-error-5xx): Your server showed an error when Google asked for the page.
- [Redirect error](https://crawlcoach.com/reasons/redirect-error): The redirects for this page are broken, too long, or go in a circle.
- [Blocked due to unauthorized request (401)](https://crawlcoach.com/reasons/blocked-due-to-unauthorized-request-401): The page needs a login, so Google can't read it.
- [Blocked due to access forbidden (403)](https://crawlcoach.com/reasons/blocked-due-to-access-forbidden-403): The server turned Google away with 403 Forbidden.
- [Blocked due to other 4xx issue](https://crawlcoach.com/reasons/blocked-due-to-other-4xx-issue): The server showed a 4xx error other than 401, 403, or 404.

## Platform guides

- [Shopify store not showing on Google](https://crawlcoach.com/platforms/shopify): A Shopify store stays off Google while it is on a trial or in private mode. Here are the common causes, in order, and the fix for each one.
- [WordPress site not showing on Google](https://crawlcoach.com/platforms/wordpress): One WordPress setting can hide your whole site from Google. Here are the common causes, in order, and where to fix each one in WordPress.
- [Webflow site not showing on Google](https://crawlcoach.com/platforms/webflow): Webflow CMS pages with little text, and the webflow.io test address, often keep pages off Google. Here are the causes, in order, and each fix.
- [Wix website not showing on Google](https://crawlcoach.com/platforms/wix): A Wix site stays off Google while it is unpublished or set to hide from search engines. Here are the common causes, in order, and each fix.
- [Squarespace website not showing on Google](https://crawlcoach.com/platforms/squarespace): A Squarespace site stays off Google while it is private or hidden from search engines. Here are the common causes, in order, and each fix.
- [Next.js pages not indexed](https://crawlcoach.com/platforms/nextjs): Next.js sites often lose pages to noindex left from staging, one canonical tag in the root layout, streamed 404s, and sitemaps with old addresses.
- [GoDaddy website not showing on Google](https://crawlcoach.com/platforms/godaddy): A GoDaddy website often misses Google because it is new, unpublished, or not in Search Console yet. Here are the causes, in order, and each fix.
- [Hostinger website not showing in Google](https://crawlcoach.com/platforms/hostinger): Hostinger Website Builder sites often stay off Google because of Coming Soon mode or the Hide page from search results setting. Causes and fixes, in order.
- [GitHub Pages site not showing on Google](https://crawlcoach.com/platforms/github-pages): New GitHub Pages sites often miss Google because they have no sitemap, no Search Console property, and few links. Here are the causes, in order.
- [Lovable site not showing on Google](https://crawlcoach.com/platforms/lovable): Older Lovable apps send an almost empty page and rely on Lovable's pre-rendering for Google. Check what Google gets, then fix the gaps in Lovable.
- [Bolt.new site not showing on Google](https://crawlcoach.com/platforms/bolt-new): The Bolt sites we tested send an empty page, answer 200 for every address, and have no real robots.txt or sitemap. Here is how to check and fix yours.
- [v0 site not showing on Google](https://crawlcoach.com/platforms/v0): v0 builds Next.js apps on Vercel, so pages usually render on the server. The usual blockers are a protected deployment, the starter title, and no sitemap.
- [Replit app not showing on Google](https://crawlcoach.com/platforms/replit): A Healthy SEO rating in Replit doesn't mean Google indexed your app. Check what Google gets, serve it from one public address, then use SEO Agent.
- [Base44 app not showing on Google](https://crawlcoach.com/platforms/base44): Base44 handles most technical SEO for apps on a custom domain. When pages still miss Google, check the domain and a few settings in SEO & GEO first.

## IndexNow guides

- [IndexNow on Cloudflare](https://crawlcoach.com/indexnow/cloudflare): If your site runs on Cloudflare, turn on Crawler Hints. It tells Bing about changes for you. No key file needed.
- [IndexNow on WordPress](https://crawlcoach.com/indexnow/wordpress): WordPress does not send IndexNow by itself. The official IndexNow plugin and most SEO plugins do.
- [IndexNow on Wix](https://crawlcoach.com/indexnow/wix): Wix tells Bing about your changes for you when you publish.
- [IndexNow on Shopify](https://crawlcoach.com/indexnow/shopify): Shopify stores add IndexNow with an app. Bing's IndexNow page lists the InstaIndex app for Shopify.
- [IndexNow on Next.js](https://crawlcoach.com/indexnow/nextjs): On Next.js, put the key file in the public folder. Then send an IndexNow request after each deploy, or let CrawlCoach send it.
- [IndexNow on Webflow](https://crawlcoach.com/indexnow/webflow): Webflow has no IndexNow setting and does not let you upload the key file. So IndexNow is not possible on Webflow.
- [IndexNow on Squarespace](https://crawlcoach.com/indexnow/squarespace): Squarespace has no IndexNow setting and does not let you upload the key file. So IndexNow is not possible on Squarespace.

## Bing indexing guides

- [Bing indexing guides](https://crawlcoach.com/bing): Why Bing is not indexing a site, and each Bing Webmaster Tools status with its fix.
- ["Discovered but not crawled" in Bing](https://crawlcoach.com/bing/discovered-but-not-crawled): Bing knows the page exists but has not crawled it yet, so it can't appear on Bing. Here is why it happens and what to do.
- ["URL cannot appear on Bing" in Bing](https://crawlcoach.com/bing/url-cannot-appear-on-bing): URL Inspection says the page is not on Bing. The line above it tells you why. Here is how to read it and fix each case.
- ["URLs with guideline issues" in Bing](https://crawlcoach.com/bing/guideline-issues): Bing crawled the page and chose not to show it. In Site Explorer it sits under Excluded or "URLs with guideline issues". Here is what to change.
- ["URLs that are robots.txt disallowed" in Bing](https://crawlcoach.com/bing/robots-txt-disallowed): A robots.txt rule tells Bingbot not to crawl these pages. Find the line that matches, check whether you meant it, and fix it if not.
- ["URLs with NOINDEX tag" in Bing](https://crawlcoach.com/bing/noindex-tag): These pages ask Bing not to show them, and Bing follows the rule. Remove the tag from pages you want on Bing. Keep it on the rest.
- ["URLs that are redirecting" in Bing](https://crawlcoach.com/bing/redirecting): These addresses send Bingbot to another page. That is fine for old addresses. It is a problem when your sitemap or links still point to them.
- ["URLs with crawling issues (deadlinks)" in Bing](https://crawlcoach.com/bing/dead-links): Bingbot asked for these pages and got a 404 or 410. Fix the ones that should exist, redirect moved pages, and let deleted pages go.
- ["URLs with crawling issues (server errors)" in Bing](https://crawlcoach.com/bing/server-errors): Bingbot got a 403 or a 5xx from your server. Often a firewall blocks Bingbot. Sometimes the server is too slow. Here is how to tell and fix it.
- [Bing blockers people miss](https://crawlcoach.com/bing/hidden-blockers): Your site is on Google but not on Bing. These Bing-only blockers are the usual reason: firewalls, crawl-delay, a missing sitemap, and more.

## AI crawler guides

- [AI crawlers compared](https://crawlcoach.com/ai-crawlers): What each AI crawler is for, whether it follows robots.txt, and which to allow.
- [OAI-SearchBot](https://crawlcoach.com/ai-crawlers/oai-searchbot): OAI-SearchBot finds pages for ChatGPT search. Block it and ChatGPT search won't show your pages in its answers. Here is how to allow it.
- [GPTBot](https://crawlcoach.com/ai-crawlers/gptbot): GPTBot collects pages that may train OpenAI's models. Blocking it does not remove you from ChatGPT search. Here are the exact lines.
- [ChatGPT-User](https://crawlcoach.com/ai-crawlers/chatgpt-user): ChatGPT-User visits a page when a person in ChatGPT asks for it. It is not a search crawler, and OpenAI says robots.txt may not apply.
- [ClaudeBot](https://crawlcoach.com/ai-crawlers/claudebot): ClaudeBot collects pages that could help train Anthropic's models. Blocking it is your choice. It does not remove you from Claude's search.
- [Claude-SearchBot](https://crawlcoach.com/ai-crawlers/claude-searchbot): Claude-SearchBot crawls pages to improve Claude's search results. Anthropic says blocking it may reduce your visibility there.
- [Claude-User](https://crawlcoach.com/ai-crawlers/claude-user): Claude-User visits pages when a person asks Claude a question. Blocking it may reduce your visibility in searches people run in Claude.
- [PerplexityBot](https://crawlcoach.com/ai-crawlers/perplexitybot): PerplexityBot finds and links pages in Perplexity's search results. Perplexity says it does not crawl for model training.
- [Perplexity-User](https://crawlcoach.com/ai-crawlers/perplexity-user): Perplexity-User loads a page when a person asks Perplexity a question. Perplexity says it generally ignores robots.txt, since a person asked.
- [Google-Extended](https://crawlcoach.com/ai-crawlers/google-extended): Google-Extended is a robots.txt token, not a crawler. It controls Gemini training and grounding. It does not affect Google Search.
- [Applebot and Applebot-Extended](https://crawlcoach.com/ai-crawlers/applebot): Applebot crawls for Siri, Spotlight, and Safari. Applebot-Extended is a robots.txt token that opts you out of Apple's model training.
- [Bingbot](https://crawlcoach.com/ai-crawlers/bingbot): Bingbot crawls for Bing search, and Bing's guidelines say Copilot uses the same crawling and index. Block it and you lose both.

## Sitemap error guides

- [Search Console sitemap errors](https://crawlcoach.com/sitemap-errors): Every Sitemaps report message, grouped by what went wrong, with the fix for each.
- [Couldn't fetch](https://crawlcoach.com/sitemap-errors/couldnt-fetch): Couldn't fetch means Google could not download your sitemap file at all. Open the address yourself, run a live test in URL Inspection, fix what blocks it, and resubmit.
- [Sitemap could not be read](https://crawlcoach.com/sitemap-errors/could-not-be-read): Sitemap could not be read means Google's download failed. The details below it, such as General HTTP error or an HTTP error with a code, tell you why.
- [Sitemap is HTML](https://crawlcoach.com/sitemap-errors/sitemap-is-html): Sitemap is HTML means the address you submitted returns a web page, not a sitemap file. Submit the XML file instead, or find what replaces it with a page.
- [Temporary processing error](https://crawlcoach.com/sitemap-errors/temporary-processing-error): Temporary processing error is a problem on Google's side, not in your sitemap. Run the inspection again later. In the Sitemaps report, resubmit only if Temporary error lasts for hours.
- [Has errors](https://crawlcoach.com/sitemap-errors/has-errors): Has errors means Google downloaded your sitemap but found problems in it. Google still uses the addresses it could read. Click the sitemap to see each error, then fix them in the file.
- [URL errors](https://crawlcoach.com/sitemap-errors/url-errors): These errors mean some addresses in your sitemap don't match where the sitemap lives, can't be read, or can't be crawled. Make every address a full URL on the same host and protocol as the sitemap.
- [XML and format errors](https://crawlcoach.com/sitemap-errors/xml-errors): These errors mean the sitemap file is not valid XML, or not in the sitemap format Google expects. Most come from a plugin or theme printing extra text, or from an unescaped &.
- [Invalid date](https://crawlcoach.com/sitemap-errors/invalid-date): Invalid date means a <lastmod> date in your sitemap is in the wrong format, or is not a real date. Use 2026-10-08, or a full time with a time zone.
- [Too large or empty](https://crawlcoach.com/sitemap-errors/size-limits): One sitemap can hold up to 50,000 URLs and 50MB uncompressed. Split a larger one into several files and list them in a sitemap index.
- [Sitemap index errors](https://crawlcoach.com/sitemap-errors/sitemap-index-errors): A sitemap index can list sitemaps, but not other sitemap indexes. Every listed sitemap needs its full address.
- [0 discovered pages](https://crawlcoach.com/sitemap-errors/discovered-pages-zero): Success with 0 Discovered pages means Google read the file but found no page addresses in it. Check what the file lists, and where it lives.
- [Old Last read or pending](https://crawlcoach.com/sitemap-errors/last-read-pending): Google re-reads a sitemap on its own schedule. A Last read date that does not move after you change pages, or a sitemap with no Last read date, needs a check.
- [Success, but pages not indexed](https://crawlcoach.com/sitemap-errors/success-not-indexed): Success means Google read your sitemap. It does not mean Google indexed the pages in it. Filter the Page indexing report by your sitemap to see why each page is left out.

## Structured data error guides

- [Search Console structured data errors](https://crawlcoach.com/structured-data): Messages from the Merchant listings, Product snippets, Review snippets, Breadcrumbs, and Unparsable structured data reports, with the JSON-LD fix for each.
- [Merchant listings: missing fields](https://crawlcoach.com/structured-data/merchant-listings-missing-field): A missing name, image, or offer price is critical: those products can't show as merchant listings until you fix it. A missing description, shippingDetails, hasMerchantReturnPolicy, or GTIN is non-critical and can wait.
- [Missing field "shippingDetails"](https://crawlcoach.com/structured-data/missing-field-shippingdetails): This is a non-critical issue in the Merchant listings report, so your products can still show with their prices. Add shipping details if you want Google to show your shipping cost and delivery time too.
- [Missing field "hasMerchantReturnPolicy"](https://crawlcoach.com/structured-data/missing-field-hasmerchantreturnpolicy): Google wants your return policy, and your product markup doesn't include it. It's a non-critical issue, so your products still qualify for merchant listings. Adding the policy lets Google show your return window and cost next to them.
- [No global identifier provided](https://crawlcoach.com/structured-data/no-global-identifier-provided): Google wants a product ID that is the same everywhere the product is sold, such as the barcode number. It's a non-critical issue: add the GTIN if your products have one, and leave the warning if they don't.
- [Either "offers", "review", or "aggregateRating"](https://crawlcoach.com/structured-data/either-offers-review-or-aggregaterating): Google found Product markup with no price, no review, and no rating, so that product can't get a rich result. Give the markup an offer, or remove the stray Product block that shouldn't be there.
- [Product snippets: missing fields](https://crawlcoach.com/structured-data/product-snippets-missing-field): Most Product snippets warnings are non-critical. Missing field "review" or "aggregateRating" usually means the page has a price but no ratings, and Google's own docs say that can trigger a warning you can leave.
- [Missing field "priceValidUntil"](https://crawlcoach.com/structured-data/missing-field-pricevaliduntil): Yes, unless the product is on sale with an end date. The warning is non-critical. Watch for the opposite problem: a priceValidUntil date in the past can stop your product's rich result from showing.
- [Invalid object type for field "brand"](https://crawlcoach.com/structured-data/invalid-object-type-for-field-brand): Your product markup gives brand the wrong type, often Thing. Change it to Brand with a name. It's a non-critical issue, so it doesn't block your product's rich result while you fix it.
- [Review snippets errors](https://crawlcoach.com/structured-data/review-snippets-errors): A Review snippets error means Google won't show stars for that item. Each one has a small fix: a supported type, a rating count, a name for the reviewed item, or the rating scale.
- [Invalid object type for field "<parent_node>"](https://crawlcoach.com/structured-data/invalid-object-type-for-field-parent-node): Google's help doesn't explain <parent_node>. Reports from site owners point to one pattern: the wrong type is on the object the markup hangs from, not on a named field. Test the live page first, then check the types below.
- [Breadcrumbs: missing fields](https://crawlcoach.com/structured-data/breadcrumbs-missing-field): Each Breadcrumbs "Missing field" error is a gap in your BreadcrumbList: an empty list, a crumb with no address, or a crumb with no name. It stops the breadcrumb trail from showing, not the page.
- [Unparsable structured data](https://crawlcoach.com/structured-data/unparsable-structured-data): Google found structured data with a syntax error, so it couldn't read that markup at all. Every item in this report is critical. When many pages share an error, a template is usually the cause.

## CrawlCoach in other languages

- [CrawlCoach: veja por que o Google ignora suas páginas](https://crawlcoach.com/pt-br): The CrawlCoach home page in Portuguese (Brazil).
- [Motivos de não indexação](https://crawlcoach.com/pt-br/motivos): Portuguese (Brazil).
- [Inspeção de URL](https://crawlcoach.com/pt-br/inspecao-de-url): Portuguese (Brazil).
- [Erros de sitemap](https://crawlcoach.com/pt-br/erros-de-sitemap): Portuguese (Brazil).
- [Dados estruturados](https://crawlcoach.com/pt-br/dados-estruturados): Portuguese (Brazil).
- [Validação do Search Console](https://crawlcoach.com/pt-br/validacao-search-console): Portuguese (Brazil).
- [Plataformas](https://crawlcoach.com/pt-br/plataformas): Portuguese (Brazil).
- [Comparações](https://crawlcoach.com/pt-br/comparacao): Portuguese (Brazil).
- [Rastreadores de IA](https://crawlcoach.com/pt-br/rastreadores-de-ia): Portuguese (Brazil).
- [Bing](https://crawlcoach.com/pt-br/bing): Portuguese (Brazil).
- [IndexNow](https://crawlcoach.com/pt-br/indexnow): Portuguese (Brazil).
- [CrawlCoach: descubre por qué Google ignora tus páginas](https://crawlcoach.com/es): The CrawlCoach home page in Spanish.
- [Motivos de no indexación](https://crawlcoach.com/es/motivos): Spanish.
- [Inspección de URLs](https://crawlcoach.com/es/inspeccion-de-url): Spanish.
- [Errores de sitemap](https://crawlcoach.com/es/errores-de-sitemap): Spanish.
- [Datos estructurados](https://crawlcoach.com/es/datos-estructurados): Spanish.
- [Validación en Search Console](https://crawlcoach.com/es/validacion-search-console): Spanish.
- [Plataformas](https://crawlcoach.com/es/plataformas): Spanish.
- [Comparativas](https://crawlcoach.com/es/comparativa): Spanish.
- [Rastreadores de IA](https://crawlcoach.com/es/rastreadores-de-ia): Spanish.
- [Bing](https://crawlcoach.com/es/bing): Spanish.
- [IndexNow](https://crawlcoach.com/es/indexnow): Spanish.
- [CrawlCoach: Warum Google Ihre Seiten auslässt](https://crawlcoach.com/de): The CrawlCoach home page in German.
- [Gründe für Nicht-Indexierung](https://crawlcoach.com/de/gruende): German.
- [URL-Prüfung](https://crawlcoach.com/de/url-pruefung): German.
- [Sitemap-Fehler](https://crawlcoach.com/de/sitemap-fehler): German.
- [Strukturierte Daten](https://crawlcoach.com/de/strukturierte-daten): German.
- [Validierung in der Search Console](https://crawlcoach.com/de/search-console-validierung): German.
- [Plattformen](https://crawlcoach.com/de/plattformen): German.
- [Vergleiche](https://crawlcoach.com/de/vergleich): German.
- [KI-Crawler](https://crawlcoach.com/de/ki-crawler): German.
- [Bing](https://crawlcoach.com/de/bing): German.
- [IndexNow](https://crawlcoach.com/de/indexnow): German.
- [CrawlCoach : pourquoi Google ignore vos pages](https://crawlcoach.com/fr): The CrawlCoach home page in French.
- [Raisons de non-indexation](https://crawlcoach.com/fr/raisons): French.
- [Inspection d'URL](https://crawlcoach.com/fr/inspection-url): French.
- [Erreurs de sitemap](https://crawlcoach.com/fr/erreurs-sitemap): French.
- [Données structurées](https://crawlcoach.com/fr/donnees-structurees): French.
- [Validation dans la Search Console](https://crawlcoach.com/fr/validation-search-console): French.
- [Plateformes](https://crawlcoach.com/fr/plateformes): French.
- [Comparatifs](https://crawlcoach.com/fr/comparatif): French.
- [Robots d'IA](https://crawlcoach.com/fr/robots-ia): French.
- [Bing](https://crawlcoach.com/fr/bing): French.
- [IndexNow](https://crawlcoach.com/fr/indexnow): French.
- [CrawlCoach: scopri perché Google salta le tue pagine](https://crawlcoach.com/it): The CrawlCoach home page in Italian.
- [Motivi di mancata indicizzazione](https://crawlcoach.com/it/motivi): Italian.
- [Controllo URL](https://crawlcoach.com/it/controllo-url): Italian.
- [Errori delle Sitemap](https://crawlcoach.com/it/errori-sitemap): Italian.
- [Dati strutturati](https://crawlcoach.com/it/dati-strutturati): Italian.
- [Convalida in Search Console](https://crawlcoach.com/it/convalida-search-console): Italian.
- [Piattaforme](https://crawlcoach.com/it/piattaforme): Italian.
- [Confronti](https://crawlcoach.com/it/confronto): Italian.
- [Crawler AI](https://crawlcoach.com/it/crawler-ia): Italian.
- [Bing](https://crawlcoach.com/it/bing): Italian.
- [IndexNow](https://crawlcoach.com/it/indexnow): Italian.
- [CrawlCoach: dlaczego Google pomija Twoje strony](https://crawlcoach.com/pl): The CrawlCoach home page in Polish.
- [Przyczyny braku indeksowania](https://crawlcoach.com/pl/przyczyny): Polish.
- [Sprawdzanie adresu URL](https://crawlcoach.com/pl/sprawdzanie-url): Polish.
- [Błędy mapy witryny](https://crawlcoach.com/pl/bledy-mapy-witryny): Polish.
- [Dane uporządkowane](https://crawlcoach.com/pl/dane-strukturalne): Polish.
- [Weryfikacja poprawek](https://crawlcoach.com/pl/weryfikacja-search-console): Polish.
- [Platformy](https://crawlcoach.com/pl/platformy): Polish.
- [Porównania](https://crawlcoach.com/pl/porownanie): Polish.
- [Roboty AI](https://crawlcoach.com/pl/roboty-ai): Polish.
- [Bing](https://crawlcoach.com/pl/bing): Polish.
- [IndexNow](https://crawlcoach.com/pl/indexnow): Polish.
- [CrawlCoach: Google がページを登録しない理由がわかる](https://crawlcoach.com/ja): The CrawlCoach home page in Japanese.
- [インデックス未登録の理由](https://crawlcoach.com/ja/reasons): Japanese.
- [URL 検査ツール](https://crawlcoach.com/ja/url-inspection): Japanese.
- [サイトマップ エラー](https://crawlcoach.com/ja/sitemap-errors): Japanese.
- [構造化データ エラー](https://crawlcoach.com/ja/structured-data): Japanese.
- [「修正を検証」の結果](https://crawlcoach.com/ja/search-console-validation): Japanese.
- [プラットフォーム別ガイド](https://crawlcoach.com/ja/platforms): Japanese.
- [ツールの比較](https://crawlcoach.com/ja/compare): Japanese.
- [AI クローラー](https://crawlcoach.com/ja/ai-crawlers): Japanese.
- [Bing のガイド](https://crawlcoach.com/ja/bing): Japanese.
- [IndexNow ガイド](https://crawlcoach.com/ja/indexnow): Japanese.
- [CrawlCoach: Google이 페이지를 건너뛴 이유 찾기](https://crawlcoach.com/ko): The CrawlCoach home page in Korean.
- [색인 미생성 이유](https://crawlcoach.com/ko/reasons): Korean.
- [URL 검사](https://crawlcoach.com/ko/url-inspection): Korean.
- [사이트맵 오류](https://crawlcoach.com/ko/sitemap-errors): Korean.
- [구조화된 데이터 오류](https://crawlcoach.com/ko/structured-data): Korean.
- [수정 결과 확인](https://crawlcoach.com/ko/search-console-validation): Korean.
- [플랫폼별 가이드](https://crawlcoach.com/ko/platforms): Korean.
- [비교](https://crawlcoach.com/ko/compare): Korean.
- [AI 크롤러](https://crawlcoach.com/ko/ai-crawlers): Korean.
- [Bing 가이드](https://crawlcoach.com/ko/bing): Korean.
- [IndexNow](https://crawlcoach.com/ko/indexnow): Korean.

## Comparisons

- [TagParrot alternative](https://crawlcoach.com/compare/tagparrot-alternative): TagParrot has closed. CrawlCoach finds the pages Google skipped, shows you why, and gives you the fix.
- [SEO Gets alternative for indexing problems](https://crawlcoach.com/compare/seo-gets-alternative): SEO Gets shows Search Console and GA4 charts. CrawlCoach does one job: it finds pages missing from Google, shows why, and gives you the fix.
- [Google Indexing API vs sitemaps](https://crawlcoach.com/compare/indexing-api-vs-sitemaps): Google's Indexing API is only for job posts and livestream videos. For all other pages, use a sitemap and links between your pages.
- [Google Search Console alternative: what to use](https://crawlcoach.com/compare/google-search-console-alternative): Nothing replaces Search Console: only Google has its index data. Here is where it falls short, and the free and paid tools that fill each gap.

## Free tools

- [robots.txt tester](https://crawlcoach.com/tools/robots-txt-tester): Test any URL against a live or pasted robots.txt for Googlebot, Bingbot, and AI crawlers, with the exact line that decides and why.
- [AI crawler checker](https://crawlcoach.com/tools/ai-crawler-checker): Check whether robots.txt or a firewall stops ChatGPT, Claude, and Perplexity search crawlers from reaching a page.
- [Sitemap checker](https://crawlcoach.com/tools/sitemap-checker): Finds a site's sitemaps, reads them, and lists each problem in Search Console's words, with a check of 10 random listed pages. No sign-up.
- [llms.txt validator](https://crawlcoach.com/tools/llms-txt-validator): Checks an llms.txt file against the llmstxt.org format, tests a sample of its links, and drafts a starting file from a site's sitemap. No sign-up.

## URL Inspection messages

- [How to read a URL Inspection result](https://crawlcoach.com/url-inspection): The verdict, Discovery, Crawl, and Indexing, top to bottom.
- [URL is on Google](https://crawlcoach.com/url-inspection/url-is-on-google): Google has the page in its index, and it can show it in search. That does not promise it shows up for the words you search.
- [URL is on Google, but has issues](https://crawlcoach.com/url-inspection/url-is-on-google-but-has-issues): The page is in Google's index. Something extra on it, such as structured data, has a problem. The page itself can still show in search.
- [URL is not on Google](https://crawlcoach.com/url-inspection/url-is-not-on-google): Google did not add the page to its index, so it can't appear in search. The reason is in the Page indexing section, right below the verdict.
- [No referring sitemaps detected](https://crawlcoach.com/url-inspection/no-referring-sitemaps-detected): Google did not match this page to a sitemap you submitted. It found the page another way, or not yet at all.
- [Referring page: None detected](https://crawlcoach.com/url-inspection/referring-page-none-detected): The tool can't show a page that links here. That does not prove no page does. It often means the page needs more links.
- [Last crawl: N/A](https://crawlcoach.com/url-inspection/last-crawl-na): Google has no successful visit to this page on record. So it has nothing indexed to show yet.
- [Crawled as: Googlebot smartphone](https://crawlcoach.com/url-inspection/crawled-as-googlebot-smartphone): Google visited the page with its mobile crawler. That is normal. For most sites, Google indexes the mobile version of each page.
- [Crawl allowed? No: blocked by robots.txt](https://crawlcoach.com/url-inspection/crawl-allowed-no-blocked-by-robots-txt): A rule in your robots.txt file tells Google not to visit this page. Google follows it, so it can't read the page.
- [Page fetch: Failed](https://crawlcoach.com/url-inspection/page-fetch-failed): Google tried to get the page from your server and could not. The words after "Failed:" say why.
- [Page fetch: Failed: Redirect error](https://crawlcoach.com/url-inspection/page-fetch-failed-redirect-error): Google followed the page's redirects and gave up. The redirects go in a circle, run too long, or lead to a bad address.
- [Server connection error](https://crawlcoach.com/url-inspection/server-connection-error): Google could not connect to your server at all. That is a problem for the whole site, not just this page.
- [Page fetch: Successful, but not indexed](https://crawlcoach.com/url-inspection/page-fetch-successful-not-indexed): Google got the page without trouble and still left it out. The reason is about the page or a duplicate, not your server.
- [Indexing allowed? No: 'noindex' detected](https://crawlcoach.com/url-inspection/indexing-allowed-no-noindex): Your page tells Google not to index it, with a noindex rule in a meta tag or an HTTP header. Google follows it.
- [User-declared canonical: None](https://crawlcoach.com/url-inspection/user-declared-canonical-none): Your page does not name a main address. For a page with no copies, that is fine.
- [Google-selected canonical](https://crawlcoach.com/url-inspection/google-selected-canonical): This is the address Google treats as the main version of the page. Inspected URL means this page. Another address means Google sees this page as a copy.
- [URL is available to Google](https://crawlcoach.com/url-inspection/url-is-available-to-google): The live test found nothing that blocks Google. That is not the same as being indexed. The live test skips several checks.
- [Indexing requested](https://crawlcoach.com/url-inspection/indexing-requested): Google added the page to its crawl queue. It will visit, then decide whether to index it. The request does not promise indexing.
- [Quota exceeded](https://crawlcoach.com/url-inspection/request-indexing-quota-exceeded): You hit Search Console's daily limit for Request indexing. Google does not publish the number. Try again the next day, and let your sitemap handle the rest.
- [Indexing request rejected](https://crawlcoach.com/url-inspection/indexing-request-rejected): Google ran a quick live test before it queued the page, and the test found a problem. Fix it, then ask again.
- [Search Console validation states](https://crawlcoach.com/search-console-validation): Validate fix asks Google to check again the pages with one issue. Here is what each state means, why validation fails, and what to do next.

## Optional

- [Pricing](https://crawlcoach.com/pricing): Plans, limits, and billing questions.
- [Privacy policy](https://crawlcoach.com/privacy): The Google data CrawlCoach reads, why, and how long it keeps it.
- [Terms of service](https://crawlcoach.com/terms): Terms, including that CrawlCoach does not guarantee indexing or ranking.
- [CrawlCoachBot](https://crawlcoach.com/bot): What CrawlCoach's crawler fetches, and why.