Geeklog Forums

If I search for 'antisource antispam techniques' in Google, I get a link to my article:

http://www.antisource.com/article.php/2004061821424811

If I search for link:www.antisource.com in Google, and weed through the results, I still get a link in the form of:

http://www.antisource.com/article.php?story=2004061821424811

And this is the case for all of my articles - there is a mixture of dynamic and static urls of the same articles in Google's index. Even though I had the static rewrite turned on, many of the links in various areas were using the the dynamic version, which still works, and Google crawls those as well. This duplication is causing havoc with my page rank and penalizing my pages (being treated as spam).

The trick is to force search engines to see the static URLs as the permanent pages without also indexing the dynamic urls. I have already cleaned up all of the geeklog code to only write the static links, but the dynamic urls will stay in google's index for some time (because they continue to get recrawled and still work). So we need to test for this when the page is loaded. If the referral is dynamic, then forward to the static page using a 302 Permanent Redirect. This will signal to Google that the dynamic page is no longer valid and to reindex using the static page.

---

www.antisource.com