Message 00416: Re: .gov crawl
- To: "Carl Malamud" <xxxx@media.org>
- Subject: Re: .gov crawl
- From: "Aaron Swartz" <xx@aaronsw.com>
- Date: Tue, 11 Nov 2008 10:53:37 -0500
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender :to:subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references :x-google-sender-auth; bh=4wZuvZKb01F2DyzrIKg4GXirQd23M3SQ8CUFGRQTB0E=; b=H0zAM0S8u3oPnlpcqNtge1cBPcmM9EP7VYxAEQZ8yUk1v1wkv49McEWVLFIg6s1WzG FhKBZ/Y1r/7Ks+VnU4hsXFmThZym30caJosqgcGDOTNi4zVVUZO+FnAa1LDLtk2izUeY GuLFsPjPPOr4B1W8ghsDojF/Ldl5IZ6WtpdQo=
- Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references:x-google-sender-auth; b=akKW2N0jZHtXySmsv+mn0/95W2e4OPu6eC26emAZDeHNN1dLTb0uFfKTnWtkoa99R7 itqRsvllJoYyOJkfqaREy+UNgjtefC3kbFNdnnWTed5/d37WEUQoZqvindQ/3gW4ZQE6 qrhFEb4gPGqQpz/j0ykOsTDyJ3LiE3QeUdhc0=
- In-reply-to: <4EAF6131-F4F8-4D6F-8A9F-567C23421180@media.org>
- References: <dc21c7860811110735pa856bb6g29784cc72a0fc7a8@mail.gmail.com> <4EAF6131-F4F8-4D6F-8A9F-567C23421180@media.org>
- Sender: xxxxxxx@gmail.com
> how current is that crawl? I really have issues with the way brewster does
> crawls ... it has never been very timely or complete and he has really
> strange restrictions on use.
They just finished it and they're starting QA. I think things have
changed a lot since Gordon took over.
A service of Public.Resource.Org.