[Date Prev] [Date Next] | [Thread Prev] [Thread Next] | [Date Index] [Thread Index] |
On Aug 13, 2009, at 8:43 PM, Aaron Swartz wrote:
Why does the robots.txt ban access to the 990 PDF scans? Disallow: /irs.gov/eo/ Disallow: /irs.gov/eo2/ Was about to load the metadata into watchdog and link to them. Should I not do that for some reason?