Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Nathan Marz's "Lambda Architecture" Approach to Big Data

DZone's Guide to

Nathan Marz's "Lambda Architecture" Approach to Big Data

· Big Data Zone ·
Free Resource

Learn how to operationalize machine learning and data science projects to monetize your AI initiatives. Download the Gartner report now.

Over at Database Tutorials and Videos, you can read a fascinating excerpt of Nathan Marz's Big Data (partially available now in an early-access edition from Manning). The article covers Marz's innovative new big data methodology that he calls "lambda architecture":

Computing arbitrary functions on an arbitrary dataset in real time is a daunting problem. There is no single tool that provides a complete solution. Instead, you have to use a variety of tools and techniques to build a complete Big Data system.


The lambda architecture solves the problem of computing arbitrary functions on arbitrary data in real time by decomposing the problem into three layers: the batch layer, the serving layer, and the speed layer.

The full article is available at Database Tutorials and Videos and is well worth the read.

Bias comes in a variety of forms, all of them potentially damaging to the efficacy of your ML algorithm. Our Chief Data Scientist discusses the source of most headlines about AI failures here.

Topics:

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}