Message 00290: Re: pacer
- To: "Carl Malamud" <xxxx@media.org>
- Subject: Re: pacer
- From: "Aaron Swartz" <xx@aaronsw.com>
- Date: Mon, 22 Sep 2008 17:01:14 -0400
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender :to:subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references :x-google-sender-auth; bh=D5w2wZACWWjW4zNGmfezSITT7urBYT//J0QB9zBDGvo=; b=pSeq3Q/77KNYVact+l9KOZEIGueMuBWO4cG80dSsnEM/k82jNjSddalpB+DH+G+Sjy 70UYg1E/iilJmPOUDjQEyTzaILU/o2CN3rShdU8ygRdmThv0TaOU1FCN2EzGg727rlhN HsEHoiwOPN1Tdfeslv+6OLJ6XAWBteahxe8aI=
- Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references:x-google-sender-auth; b=NQkbdUR7R7rDIeJHIbwd3V4MTec3urKjTfgmYP5qWHGTiGcZHAUrcvDDAtuKvxsycJ GyrKAtYKxfq6rVboxGJJ1+ZTL/cb6oZneQrwJ4UPRWHc7J9zlG8FXLkE77dc4h7CNV3I TpvZMZMao7sKmZqT7kVsrJyUeMWcc/+ghO8QI=
- In-reply-to: <D3084EED-3530-450C-9FA3-7621AAFA02CA@media.org>
- References: <D3084EED-3530-450C-9FA3-7621AAFA02CA@media.org>
- Sender: xxxxxxx@gmail.com
> let me know how your pacer stuff is going. I see you're up to 722gbytes.
Yes, it seems to be going pretty well.
> a terabyte of data is definitely a good-sized chunk ... you folks can keep
> harvesting, but I can start the next steps at some convenient point.
Stephen's planning on doing something more targeted with
Massachusetts, so he wants to get all of that, but with the rest of it
I think we can start whenever you like. I think the best thing would
be to leave the current pacer directory as a clean copy and dump the
processed versions of this stuff someplace new. Is that OK?
Hmm, the crawlers all seem to have died so now might be a good time.
Although I should probably look into why.
- Follow-Ups:
- Re: pacer
- From: Carl Malamud <xxxx@media.org>
- Re: pacer
- From: "Aaron Swartz" <xx@aaronsw.com>
- References:
- pacer
- From: Carl Malamud <xxxx@media.org>