MADlib: Big Data Machine Learning in SQL for Data Scientists
MADlib: Big Data Machine Learning in SQL for Data Scientists
Join the DZone community and get the full member experience.
Join For FreeLearn how to operationalize machine learning and data science projects to monetize your AI initiatives. Download the Gartner report now.
Data scientists and others working with Big Data may be interested in MADlib, an open-source framework for Big Data machine learning in SQL. As of November 25th, the framework is on version 1.4, and includes such features as support for Postgres, Pivotal Greenplum Database, and Pivotal HAWQ, a commercially usable BSD license, and more. According to the MADlib team, the key philosophies in MADlib's development are the following:
Check out MADlib's full site for more details. You can also find a list of features, as well as documentation, if you want to learn more.
Operate on the data locally—in database. Do not move it between multiple runtime environments unnecessarily.
Utilize best of breed database engines, but separate the machine learning logic from database specific implementation details.
Leverage MPP Share nothing technology, such as the Pivotal Greenplum Database, to provide parallelism and scalability.
Open implementation maintaining active ties into ongoing academic research.
Bias comes in a variety of forms, all of them potentially damaging to the efficacy of your ML algorithm. Our Chief Data Scientist discusses the source of most headlines about AI failures here.
Like This Article? Read More From DZone
Opinions expressed by DZone contributors are their own.
{{ parent.title || parent.header.title}}
{{ parent.tldr }}
{{ parent.linkDescription }}
{{ parent.urlSource.name }}