k, created ... have disallow set for cvsweb.cgi, regress and docs ...
On Tue, 10 Aug 2004, John Hansen wrote:
>>
>> I can put them there, if someone can point to me either a
>> format for, or a sample file of, the robots.txt file?
>>
>
> http://www.robotstxt.org/wc/norobots.html
>
> Regards,
>
> John
>
----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664