[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Message 00289: pacer

let me know how your pacer stuff is going. I see you're up to 722gbytes.

i have a ssn scanner I can run over your data at an appropriate time.

and, I'd like to do the metadata thing in the headers and the url correction at some point as well.

a terabyte of data is definitely a good-sized chunk ... you folks can keep harvesting, but I can start the next steps at some convenient point.