Is robots.txt blocking important pages?

This post explains how i fixed “Is robots.txt blocking important pages?” problem.

Below are the problems i faced,

  • My website description is not available in Google search results because of robots.txt
  • My Google webmaster tools account was displaying “Is robots.txt blocking important pages?” message

It was strange to me. Robots.txt had the following lines,

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Sitemap: http://www.dezvolta.co.uk/sitemap.xml

But nothing worked. I was testing my webmaster account fetching my robots.txt again and again. Nothing worked by that time. Then finally i tried the following,

Solution

I deactivated Google XML Sitemaps plugin from my WordPress admin and immediately i got this issue fixed in my Google web master tools. And more importantly Google search results showed my website description.

You can also try deactivating any WordPress seo plugin installed and activate it from your WordPress admin to fix this.

Hope this helps!

Comments are closed.
* required
We no more support old browsers. Kindly upgrade to IE 8, IE 9 or Google Chrome or any modern browsers.