Running MapReduce Jobs on Windows (Personal Laptops)

Running MapReduce jobs on cloud VMs or your enterprise servers is not always the best options when all you want to do is to test something without actually processing a big chunk of data.

The below steps help you set up the required configurations to run MR workloads on your personal laptop.

1. Install hadoop-common-2.2.0-bin-master (Many GitHub repositories host the source code for the     this software).

2. Set HADOOP_HOME as an environment variable pointing to the location of this folder.

3. Add %HADOOP_HOME%\bin to the  PATH environment variable

4. Add the following Maven dependency to your code:

<!-- Add the following dependency in your pom.xml -->
<dependencies>
  <dependency>
   <groupId>org.apache.hadoop</groupId>
   <artifactId>hadoop-client</artifactId>
   <version>2.2.0</version>
  </dependency>
</dependencies>

And you're done! To continue your MapReduce journey, check out this post!