Preventing URL’s from being crawled by Googlebot



Good uses for the Google webmaster tools. Including ways and reasons you may want to exclude certain url’s on your website. He also covers the use of the htaccess, robots.txt and even password protecting areas of your site.

He also bring up holes in the use of the nofollow tags. This is really good info if you plan on using the nofollow tag.



Related posts:

  1. Dynamic URL’s versus Static URL’s, Geo location, getting hacked

Posted on June 9th, 2008 in Matt Cutts Video Interviews | No Comments »

Leave a comment!

XHTML: Allowed tags: <a href="" title=""> <abbr title=""> <acronym title=""> <blockquote cite=""> <code> <em> <strong>