[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]


Message 00303: Re: wais dump?

i don't think they'd do it.  they are *very* sluggish.

On Sep 23, 2008, at 3:05 AM, Aaron Swartz wrote:


What do you think about asking GPO for a dump of their WAIS box? It
looks like there's a lot of stuff on there that you're not crawling
and robots.txt is preventing it from getting indexed. It'd sure be
nice to have it online.

this came up because i heard there are some financial disclosure forms
in there somewhere, but who knows how to find them.