Wide Finder 2: processing 42GB of httpd logs, 300X faster than naïve Ruby

Previous | Next

By bloid
via eigenclass.org
Published: Oct 28 2008 / 15:14

The Wide Finder 2 benchmark measures the speed at which a program can analyze 42GB worth of webserver logs and generate basic statistics (top URLs by hits, byte count and 404 errors, top clients and referrers) on a pretty beefy machine: a 8-core Sun Fire T2000 with 32 hardware threads and 32GB of RAM.

Vote up

Vote down