Running MapReduce Jobs on Windows (Personal Laptops)
Learn how to run MapReduce jobs on your personal machine so can take advantage of Hadoop on data sets that don't qualify as 'big data.'
Join the DZone community and get the full member experience.Join For Free
Running MapReduce jobs on cloud VMs or your enterprise servers is not always the best options when all you want to do is to test something without actually processing a big chunk of data.
The below steps help you set up the required configurations to run MR workloads on your personal laptop.
Install hadoop-common-2.2.0-bin-master (Many GitHub repositories host the source code for the this software).
HADOOP_HOMEas an environment variable pointing to the location of this folder.
Add %HADOOP_HOME%\bin to the
Add the following Maven dependency to your code:
<!-- Add the following dependency in your pom.xml --> <dependencies> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-client</artifactId> <version>2.2.0</version> </dependency> </dependencies>
And you're done! To continue your MapReduce journey, check out this post!
Opinions expressed by DZone contributors are their own.