Ask the community if you have any question about PHP,
MySQL, Apache and Linux for quick answers!!!

Archive for August, 2011

Google does not honor robots.txt and noindex

For quite some time Google is considering web site performance a critical factor in search rankings. Recently a list of most-asked questions is published by Strangeloop in which they have discussed some frequently asked questions how Google factors web site performance into its search rankings.

One of the point they discussed

Q: Do they measure pages marked as non-crawlable?
Yes. They measure pages your users use, not what you have told Google is crawlable

So it means, the pages you mentioned not to crawl by Google in robots.txt or using meta tag noindex is not honored by Google if these are being visited by users (given the users have Google toolbar installed).

Many sites have some reporting tools which run on the same domain name and most of the reports take time to generate. It'll definitely impact your search ranking if you have Google toolbar installed in the browser where you are viewing reports. To stop impacting this on your search ranking you can either uninstall Google toolbar or disable PageRank feature. This tip has improved search ranking of my friend's site.

Comments

Fed-up of updating status to multiple social platforms?

Are you fed-up of updating status to multiple social platforms? Don't worry, Hellotxt is a cool service to update your status to multiple services. This will save a lot of your time.

Comments