As I have told you in my last post duplicate causes problems to the Google PR, in this article I will share couple of ways with witch you can remove duplicate content:
1. canonical Url
You should chose your favorite canonical Url. (with www or without www).
Google indexes both www.bitdoze.com and bitdoze.com giving them 2 different pageranks.
The best way is to modify your .htaccess file to make a server redirect from the non www to the www version.
Here is what you can add to get read of this problem:
RewriteEngine On
RewriteCond %{HTTP_HOST} ^bitdoze.com [NC]
RewriteRule (.*) http://www.bitdoze.com/$1 [L,R=301]
2. with / or without /
Sometimes your links can be indexed in different way:
http://www.bitdoze.com/seo/how-duplicat-content-can-effect-the-seo
http://www.bitdoze.com/seo/how-duplicat-content-can-effect-the-seo/
So this is a duplicate content problem again, to fix this again you have to modify the .htaccess and you should add:
RewriteBase /
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_URI} !(.*)/$
RewriteRule ^(.*)$ http://www.bitdoze.com/$1/ [L,R=301]
3. Modify the Robots Meta
It is very important to keep the track of what it is indexed for your website, it wouldn’t be that good if a content is indexed more then one time that’s why you have to keep the track of what is indexed.
In wordpress exist a plug-in called Robots Meta and this can help you in this matter:
- Prevent indexing of your search result pages, while still allowing the search engines to follow the links on them, by adding
noindex,followrobots meta tags. - Prevent indexing of the subpages to your homepage, by adding a
noindex,follow. - Prevent indexing of your login, register and admin pages by adding
noindexrobots meta tags. - Add
noodpannoydirmetarobots tags, allowing you to opt out of DMOZ and Yahoo! Directory descriptions. - Prevent Yahoo! and Google from indexing your feeds by adding a
metatag to theirhead-section. - Disable author and date-based archives.
- Nofollow the category listings on single posts and pages to prevent PageRank leakage.
- Nofollow outbound links on your frontpage.
- Nofollow tag links.
- Edit your robots.txt and .htaccess from within your WordPress.
- Add robots meta tags to individual posts and pages.
- Verify your site with Google Webmaster Tools and Yahoo! Site Explorer.
- In WordPress 2.3 and up:
- Prevent indexing of just your comment feeds.
- Enforce a trailing slash on archive and tag pages
Here you can find a short video of how to do this:
So this are some ways in witch you can prevent a duplicate content.
I have take a look of some sites that has PR of 6,7 and they did not had duplicate content so I think it will be good to follow some of this steps and if you have other ideas I am willing to lessen.
Hello,
Thank you for this great info !
Really helpful.
I feel I like the www. more. Some would disagree, but I guess it looks more professional.
These are some great tips, and you make a good point. High PR sites all direct to the same site, with or without www.
.-= Cartoon Games´s last blog ..Strangers 3 =-.
Thanks the post… you have explain every point very clearly…
Really this post was informative, I too have doubt how to remove duplicate contents in our web sites, after i read this post, i clear with this
.-= eGrove Systems´s last blog ..Home =-.
Really good stuff. Will recommend this to my clients. Anyways, where did you get this information?
.-= Pregnancy Miracle´s last blog ..Curing Hopelessness – Amazing 5 Minute Exercise Inside =-.
First when I have discovered this issue I searched on the internet ways of getting reed of it so I have putted here what I have found on some sites and what I have analise on some sites that have PR of 6,7
I never know what to do with the robots text file, this helps a lot.
Correction – First paragraph – Told is spelled t o l d, not tolled.
Ohh man, thank’s very much. Really helpful !!
.-= filme online gratis´s last blog ..Nunta muta =-.
Very Informative post.its help me to remove my web duplicate content.
very usefull information , thanks for that
I was looking for this. A great help from bitdoze.com. Thanks dude
Thank you so much for the information i ll surly work on it
Thank you for such a fantastic blog. Where else could anyone get that kind of info written in such a perfect way? I have a presentation that I am presently working on, and I have been on the look out for such information.
This post was very nicely written, and it also contains a lot of useful facts. I appreciated your professional way of writing this post. Thanks, you have made it very easy for me to understand.
I am trying to be as clear as possible, sometimes isn’t that easy, if sometime I will be unclear let me know and I will try to be more clear.
This is my first visit to your blog. We are starting a new initiative in the same niche as this blog. Your blog provided us with important information to work on. You have done a admirable job.
Hi. I wanted to drop you a quick note to express my thanks. I’ve been following your blog for a month or so and have picked up a ton of good information as well as enjoyed the way you’ve structured your site. I am attempting to run my own blog but I think its too general and I want to focus more on smaller topics. Being all things to all people is not all that its cracked up to be.
Thank you for another fantastic blog. Where else could I get this kind of info written in such an incite full way? I have a presentation that I am just now working on, and I have been looking for such information.
Thanks for taking this opportunity to discuss this, I feel fervently about this and I like learning about this subject. If possible, as you gain information, please update this blog with more information. I have found it really useful.
Merely want to say your article is brilliant. The clearness in your post is simply spectacular and i can take for granted you are an expert on this field. Well with your permission allow me to grab your rss feed to keep up to date with forthcoming post. Thanks a million and please keep up the sound work.
I Really realize what your position in this matter is. Though I should disagree on a number of the finer details, I think that you did a wonderful job explaining it. Definitely beats having to study it by myself. Thank you.
This is my second visit to this blog. We are starting a new initiative in the same category as this blog. Your blog provided us with valuable information to work on. You have done a admirable job.
That is very inspirational stuff. Never known that feeling can be this diversified. Thanks for all the enthusiasm to extend such helpful information on this post. . . .
This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work.
I would like to thank you for the endeavors you have made in publishing this article. I am trusting the same best work from you in the future as well. In fact your fanciful writing abilities has inspired me to start my own blog now. Genuinely the blogging is spreading its wings rapidly. Your write up is a fine example of it.Thanks again for sharing this free online
Awesome post, I’m a huge believer in commenting on blogs and forums to assist the blog creators know that they have created something of worth to the cyberspace!
I would like to thank you for the efforts you have made in writing this article. I am hoping the same best work from you in the future as well. In fact your creative writing abilities has inspired me to start my own BlogEngine blog now. Really the blogging is spreading its wings rapidly. Your write up is a fine example of it.
Cool post! How much stuff did you have to look up in order to write this one? I can tell you put some work in.
I was doing research for my blog and after looking for some days on the internet I have found some articles of how to remove duplicate content.
Hey, maybe this is a bit offf topic but in any case, I have been surfing about your blog and it looks really neat. impassioned about your writing. I am creating a new blog and hard-pressed to make it appear great, and supply excellent articles. I have discovered a lot on your site and I look forward to additional updates and will be back.
very nice post dude! great website… will be back soon!
Thanks for the tips. I thought I had everything done but I’d missed #2 — the part about the slashes. I will implement that today. Thanks again.
Firebird Hosting last post ..Response cached until Tue 20 @ 15:21 GMT (Refreshes in 23.70 Hours)
This is a problem that occurs on numerous occasions. Thank you for shedding light on this matter. Great post.