Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Kafka and Hadoop YARN Used in New Apache Stream Processing Incubator

DZone's Guide to

Kafka and Hadoop YARN Used in New Apache Stream Processing Incubator

· Integration Zone ·
Free Resource

Discover how you can get APIs and microservices to work at true enterprise scale.

There's a new proposal in the Apache Incubator for a project called Samza.  The description says it's a streaming data processor that can continually compute more streams than you could possibly need.

The new project is a contribution from the internal toolset of LinkedIn, so it's no surprise that they are using their own pub/sub system, Apache Kafka.  Another project being used by Samza is Apache YARN, which is used "to make decisions about stream processor locality, co-partition of streams, and provide security." 

Check out the incubator page for the full scoop and see if it looks exciting or useful for your own use case.

APIs and microservices are maturing, quickly. Learn what it takes to manage modern APIs and microservices at enterprise scale.

Topics:

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}