Geeklog Forums

How would I write a robots.txt so that robots do not index my print-layout of stories? I found out that users search for things on google, find it on my homepage but are redirected on the print-layout without menus etc...

thanks

That's not possible since the robots.txt standard does not support regular expressions or the like. It only allows substrings, so you can only exclude URLs that start with a certain string but not those that end in some string (like .../print for the printable pages).

It may be possible to do something about this with some .htaccess magic (anyone?) or you could disable the link to the printable format altogether.

And, yes, the bots love the printable pages (no clutter, just text). There's a link back to the article at the bottom of that page - you may want to make that more obvious for your human visitors.

bye, Dirk

I don't know how well it works but you can add the rel=”nofollow” tag to your link and Google at least shouldn't follow it.

---

Yes I am mental.

I've solved it using a hack in article.php and staticpages/index.php

This is the cide added in article.php


Maybe something like this should be in the geeklog distribution and control it from config.php.

---

Geeklog Plugins: http://plugincms.com

Google (and other search engines?) do support some non standard commands in robots.txt, some of which may help you. For example:
[QUOTE robots.txt]
User-agent: Googlebot
Disallow: /*.php/*/print$
[/QUOTE]