Link Details

Link 981577 thumbnail
User 875635 avatar

By mikopp
via apmblog.compuware.com
Published: Jun 12 2013 / 10:44

For a while now I have been writing about how to analyze and optimize Hadoop jobs beyond just tweaking MapReduce options. The other day I took a look at some of our Outage Analyzer Hadoop jobs and put words into action. A simple Analysis and some simple fixes lead to a 2x improvement overall and a 6x improvement on the Reduce part of the job!
  • 12
  • 2
  • 732
  • 985

Add your comment


Html tags not supported. Reply is editable for 5 minutes. Use [code lang="java|ruby|sql|css|xml"][/code] to post code snippets.

Apache Hadoop
Written by: Piotr Krewski
Featured Refcardz: Top Refcardz:
  1. Play
  2. Akka
  3. Design Patterns
  4. OO JS
  5. Cont. Delivery
  1. Play
  2. Java Performance
  3. Akka
  4. REST
  5. Java