Should I block duplicate pages using robots.txt?

Filed Under ( SEO, Tips, google ) by admin on 18-03-2010

Tagged Under : , , ,

Halfdeck from Davis, CA asks: “If Google crawls 1,000 pages/day, Googlebot crawling many dupe content pages may slow down indexing of a large site. In that scenario, do you recommend blocking dupes using robots.txt or is using META ROBOTS NOINDEX,NOFOLLOW a better alternative?”

Short answer: No, don’t block them using robots.txt. Learn more about duplicate content here: http://www.google.com/support/webmasters/bin/answer.py?answer=66359

Thumbnail

Related Posts with Thumbnails

No related posts.

Related posts brought to you by Yet Another Related Posts Plugin.

Post a comment

blog comments powered by Disqus
Get Adobe Flash playerPlugin by wpburn.com wordpress themes