Hadoop: Installation Guide
Join the DZone community and get the full member experience.Join For Free
Thank you for the overwhelming response to my two articles written in Big Data zone earlier. If you haven't read them yet, you can find their link here in my profile. We have reached a point where we want to install Hadoop on our local system or containers. So, this is a short installation guide to take us through the process:
- A Unix-based shell is needed. Linux (preferred) or Mac machines will be good to start on.
- Java (JDK 8) installed.
Steps to proceed:
- Download the official Hadoop dependency from Apache. Scroll to the binary and download it.
- Extract the tar file downloaded by GUI or use:
tar -xvfz <tar name>
- Move to the directory of extracted tar to
/usr/local/hadoopwith a GUI or use:
mv hadoop-<version> /usr/loacal/hadoop.
You may also like: An Overview of the Hadoop Ecosystem of Beginners.
In the following steps, we will be configuring Hadoop's Java home:
- Check the
JAVA_HOMEand copy its value.
- Edit the Hadoop environment(
sudo vi /usr/local/hadoop/etc/hadoop/hadoop-env.sh
- Update the
JAVA_HOMEin it with the value you copied from above the previous step:
export JAVA_HOME=<value copied from JAVA_HOME>
- Hadoop has been set up and can be run from the command line in the following directory:
Congratulations! Hadoop has been successfully installed in your system!
Opinions expressed by DZone contributors are their own.