In Pictures: 18 essential Hadoop tools for crunching big data

Making the most of this powerful MapReduce platform means mastering a vibrant ecosystem of quickly evolving code

In Pictures: 18 essential Hadoop tools for crunching big data prev next

Loading...

Oozie Breaking up a job into steps simplifies everything. If you break your project into multiple Hadoop jobs, Oozie is ready to start them up in the right sequence. You won't need to babysit the stack, waiting for one job to end before starting another. Oozie manages a workflow specified as a DAG (directed acyclic graph). (Cyclic graphs are endless loops, and they're traps for computers.) Just hand Oozie the DAG and go out to lunch.

The image at left shows one flowchart from the Oozie documentation. The code, protected by the Apache license, is found at http://oozie.apache.org/.

Prev Next 14/19

Comments on this image

There are currently no comments for this image.

Comments are now closed.

Close

In Pictures: 18 essential Hadoop tools for crunching big data

19 images
Shopping.com

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?