Welcome to Geeklog, Anonymous Friday, April 25 2025 @ 03:13 pm EDT

Comments for Using a robots.txt file

Using a robots.txt file | 8 comments | Create New Account

The following comments are owned by whomever posted them. This site is not responsible for what they say.

Using a robots.txt file

Authored by: NeoNecro on Sunday, October 03 2004 @ 02:48 pm EDT

Wow, what do you have on your site??
In two months time googlebot only used 25MB of my banwidth and my site is quiete active and I have over 200 hundred of articles.
Your site has to gigantic.

---
webside.info

---
dimis-site.be

Search

Resources

About

Getting started

Support

Development

Topics

User Functions

What's New

Articles last 4 weeks

Comments last 4 weeks

Pages last 4 weeks

Links last 4 weeks

Downloads last 4 weeks