Skip to content

"Indexed, though blocked by robots.txt": what it means and how to fix it

Google lists the page because of links, but robots.txt stops Google from reading it.

A setting blocks it

What it means

Google can't visit the page, but lists it anyway because other pages link to it. The search result usually has no description.

Which of your pages have this problem? Find out for free.

Get my free report

Common causes

  • A robots.txt rule blocks a page that other pages link to.

How to fix it

  • If you want the page on Google, remove the robots.txt rule.
  • If you want the page off Google, let Google visit it and add a noindex tag. Google has to visit the page to see noindex.

How to find these pages

In Search Console, open Indexing > Pages and click the "Indexed, though blocked by robots.txt" row. Search Console shows up to 1,000 example pages. CrawlCoach checks up to 50,000 pages per site and sorts them by reason, so you know which pages to fix first.

Which of your pages have this problem?

Sign in with Google. CrawlCoach checks up to 500 pages for free and shows the fix for each problem.

Get my free report

Free for up to 500 pages. No card needed. Sign in with the Google account you use for Search Console.

Related problems