[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]


Message 00811: Re: pacer



tell me when you're done loading and I'll crawl it.

why can't you get yourself an account/system with a few terabytes of disk? 
Shouldn't be that hard. I offered to put you in touch with Vixie, there are 
lots of folks on the east coast that would host a box for you. Or, if that 
doesn't work, just do the amazon thing. You should have your own resources. 
You're smart enough and it isn't expensive to do anymore. spending $1k a month 
or even $2k a month is not an unreasonable professional expense and if you want 
to be much cheaper than that, a guest box in somebody's rack can be $1k or less.

On Jan 3, 2011, at 9:02 AM, Aaron Swartz wrote:

> i don't think i have the disk for both a zip file and the raw stuff.
> there will be a few more files over the next couple days (caed is
> being a real pain), but it's 97% there. 120GB.
> 
> feel free to crawl it.
> 
> On Mon, Jan 3, 2011 at 11:58 AM, Carl Malamud <xxxxxxx@media.org> wrote:
>> very nice. want me to crawl it? let me know when it is ready.
>> 
>> (you could also create a big zip file at the top level if you want ... )
>> 
>> On Jan 3, 2011, at 8:31 AM, Aaron Swartz wrote:
>> 
>>> found a dreamhost account I could use:
>>> 
>>> http://protect.theinfo.org/pacer/
>>> 
>> 
>> 
>