Over a million developers have joined DZone.

Kafka and Hadoop YARN Used in New Apache Stream Processing Incubator

DZone's Guide to

Kafka and Hadoop YARN Used in New Apache Stream Processing Incubator

· Integration Zone ·
Free Resource

SnapLogic is the leading self-service enterprise-grade integration platform. Download the 2018 GartnerMagic Quadrant for Enterprise iPaaS or play around on the platform, risk free, for 30 days.

There's a new proposal in the Apache Incubator for a project called Samza.  The description says it's a streaming data processor that can continually compute more streams than you could possibly need.

The new project is a contribution from the internal toolset of LinkedIn, so it's no surprise that they are using their own pub/sub system, Apache Kafka.  Another project being used by Samza is Apache YARN, which is used "to make decisions about stream processor locality, co-partition of streams, and provide security." 

Check out the incubator page for the full scoop and see if it looks exciting or useful for your own use case.

With SnapLogic’s integration platform you can save millions of dollars, increase integrator productivity by 5X, and reduce integration time to value by 90%. Sign up for our risk-free 30-day trial!


Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}