Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Kafka and Hadoop YARN Used in New Apache Stream Processing Incubator

DZone's Guide to

Kafka and Hadoop YARN Used in New Apache Stream Processing Incubator

· Integration Zone ·
Free Resource

How to Transform Your Business in the Digital Age: Learn how organizations are re-architecting their integration strategy with data-driven app integration for true digital transformation.

There's a new proposal in the Apache Incubator for a project called Samza.  The description says it's a streaming data processor that can continually compute more streams than you could possibly need.

The new project is a contribution from the internal toolset of LinkedIn, so it's no surprise that they are using their own pub/sub system, Apache Kafka.  Another project being used by Samza is Apache YARN, which is used "to make decisions about stream processor locality, co-partition of streams, and provide security." 

Check out the incubator page for the full scoop and see if it looks exciting or useful for your own use case.

Make your mark on the industry’s leading annual report. Fill out the State of API Integration 2019 Survey and receive $25 to the Cloud Elements store.

Topics:

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}