[Rack] Crawling Noisebridge-discuss Archives

Andy Isaacson adi at hexapodia.org
Tue May 15 07:05:11 UTC 2012


On Mon, May 14, 2012 at 07:29:13PM -0700, Jared Dunne wrote:
> I'd like a copy of the mbox file.

URL sent under separate cover.

> I'm still running that crawler, btw.  The web format is pretty handy
> for my project since it's an excuse to use Nutch for the ML group.

No worries, the server can handle the load.  If you want to crank it up
to one GET per second I'm fine with that.

-andy



More information about the Rack mailing list