How HDFS Does Replication
by
Join the DZone community and get the full member experience.
Join For FreeAs I learned about HBase and HDFS, I wanted to understand how HDFS
actually does its replication, whether it's an synchronous replication,
what is the flow. As it turns out, it wasn't easy to find the answers to
these questions, but I ran into a very good page on the internals and
how HDFS works that is worth sharing:
Understanding Hadoop Clusters and the Network
Another aspect of HBase and HDFS is the ingenuity of having a filesystem
that is good enough for Hadoop and then building a database on top of
it, without reinventing the wheel. Kudos to Google for their work on
GFS, MapReduce, and BigTable, which inspired the open source
implementations.
Published at DZone with permission of Rodrigo De Castro, DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.
Comments