Link Details

"Cascading for the Impatient" is a series of blog posts which show how to get started using Cascading. Quickly, like yesterday. The intent is to provide useful code which can be applied elsewhere, while examining best practices for leveraging the API. In addition to showing "How", these blog posts also discuss the "Why" of engineering trade-offs involved in deploying robust MapReduce apps at scale, and test-driven development (TDD) for "Big Data". Cascading is an open source project which provides an API for MapReduce apps. Think of it as enterprise-grade workflow orchestration atop Hadoop, with bindings in Java, Scala, Clojure, Python, and Ruby. In the "Impatient" series, we look in detail at a program which starts out as the simplest Cascading app possible, a distributed file copy. Then we add a few changes to the code in each additional post, until we have a full TF*IDF implementation for Hadoop.