Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

HAWQ and MADlib for Hadoop Go Open-Source

DZone's Guide to

HAWQ and MADlib for Hadoop Go Open-Source

Pivotal announced that two of their offerings, HAWQ and MADlib, will become open-source under the Apache Software Foundation.

· Database Zone
Free Resource

Whether you work in SQL Server Management Studio or Visual Studio, Redgate tools integrate with your existing infrastructure, enabling you to align DevOps for your applications with DevOps for your SQL Server databases. Discover true Database DevOps, brought to you in partnership with Redgate.

Today, Pivotal announced that two of their offerings, HAWQ and MADlib, will become open-source under the Apache Software Foundation.

HAWQ is a SQL analytics engine for Hadoop built on HDFS, the distributed Java-based filesystem by Hortonworks. MADlib is a library for scalable in-database analytics/machine learning.

HAWQ is interesting because it allows you to get data in a declarative way, instead of for instance writing procedural MapReduce algorithms. From an enterprise perspective, businesses now have available to them an open-source tool that's already been proven in proprietary versions in demanding and high-scale environments.

MADlib, having been previously propriety, will surely become a valuable open-source tool for data scientists and developers interested in Big Data applications.

If you're familiar with Hadoop and want to explore MADlib and HAWQ on a Hadoop cluster, Pivotal Academy offers a course to get you up-to-speed which is currently open for registration. You can check out "MH101: MADlib HAWQ over Hadoop" here.

Pivotal will continue to support and develop HAWQ and MADlib, just as other private organizations such as Oracle support and develop open-source projects like Java.

Interestingly, some analysts have pointed out that this announcement from Pivotal is akin to an attack on Oracle and an attempt to "kill the traditional database." Whether this is actually the ultimate goal of this move by Pivotal and if they will be successful in their endeavor is obviously yet to be seen.

It’s easier than you think to extend DevOps practices to SQL Server with Redgate tools. Discover how to introduce true Database DevOps, brought to you in partnership with Redgate

Topics:
database ,pivotal ,hawq ,madlib ,hadoop

Opinions expressed by DZone contributors are their own.

THE DZONE NEWSLETTER

Dev Resources & Solutions Straight to Your Inbox

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.

X

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}