Welcome to Geeklog, Anonymous Friday, April 25 2025 @ 08:00 am EDT

Comments for Using a robots.txt file

Using a robots.txt file | 8 comments | Create New Account

The following comments are owned by whomever posted them. This site is not responsible for what they say.

Using a robots.txt file

Authored by: Marites on Saturday, October 02 2004 @ 06:09 pm EDT

Forgot this particlar validator should have URL/robots.txt not the actual site will look up the URL of the one I normally use that allows the site url and seeks out the robot.txt. Sorry about previous post.

Marites

Search

Resources

About

Getting started

Support

Development

Topics

User Functions

What's New

Articles last 4 weeks

Comments last 4 weeks

Pages last 4 weeks

Links last 4 weeks

Downloads last 4 weeks