[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [vps-mail] REQUEST



On Mon, Jun 27, 2005 at 12:45:48PM -0500, Rae French wrote:
> Thanks, Scott. Those changes help tremendously. There is just one other 
> thing that I would add and that would be to have a robots.txt file in the 
> archive directory to stop the spiders from catching the posts. Other than 
> that, I'm happy. :)

I've considered that in the past, but I also know that our archives
are immensely useful for other open-source software users (close to
20k hits in June for the vps-mail archive).

It wouldn't be hard, of course, and we still have the list's
(open-source) htdig search engine to find messages. Does everyone else
feel the same way about closing off the list archives to spiders? I'd
like to get some kind of feel for what other folks feel before I shut
'er down to robots.

Scott
-- 
Scott Wiersdorf
scottw@xxxxxxxxxxxx
======================================================================
This is <vps-mail@xxxxxxxxxxxx>       <http://www.perlcode.org/lists/>
Before posting a question, please search the archives (see above URL).


Main Index | Thread Index
Match: Format: Sort by:
Search: