"Indexed, though blocked by robots.txt": what it means and how to fix it
Google lists the page because of links, but robots.txt stops Google from reading it.
A setting blocks it
What it means
Google can't visit the page, but lists it anyway because other pages link to it. The search result usually has no description.
Which of your pages have this problem? Find out for free.
Get my free reportCommon causes
- A
robots.txtrule blocks a page that other pages link to.
How to fix it
- If you want the page on Google, remove the
robots.txtrule. - If you want the page off Google, let Google visit it and add a
noindextag. Google has to visit the page to seenoindex.
How to find these pages
In Search Console, open Indexing > Pages and click the "Indexed, though blocked by robots.txt" row. Search Console shows up to 1,000 example pages. CrawlCoach checks up to 50,000 pages per site and sorts them by reason, so you know which pages to fix first.
Which of your pages have this problem?
Sign in with Google. CrawlCoach checks up to 500 pages for free and shows the fix for each problem.
Get my free reportFree for up to 500 pages. No card needed. Sign in with the Google account you use for Search Console.