Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

SpringOne2GX 2015 Replay: Stream Processing at Scale With Spring XD and Kafka

DZone's Guide to

SpringOne2GX 2015 Replay: Stream Processing at Scale With Spring XD and Kafka

Learn about stream processing at scale using Kafka and Spring XD in a recap of SpringOne2GX 2015.

· Java Zone
Free Resource

Try Okta to add social login, MFA, and OpenID Connect support to your Java app in minutes. Create a free developer account today and never build auth again.

In the recent years, drastic increases in data volume, as well as a greater demand for low latency have led to a radical shift in business requirements and application development methods. Near-realtime data processing has started to become more prevalent, and high-throughput messaging systems such as Apache Kafka have emerged as key building blocks. Focusing on developer experience and productivity, Spring XD makes it easy to develop big data applications, without the need for dealing with the details of integrating and scaling a big data stack. In the particular context of Kafka, this means allowing developers to benefit from its specific features and power, while at the same time remaining focused on writing and testing business logic. To begin, we will provide a brief introduction of how Kafka is supported in the Spring ecosystem in general, in Spring Integration and Spring Data, and then we will discuss how Spring XD integrates with Kafka as an external data source and transport. And because we like all things practical, the core part of the presentation will walk you through a demo that will show you how to unleash the power of Kafka with Spring XD, by building a highly scalable data pipeline with RxJava and Kafka, using Spring XD as a platform.

Recorded at SpringOne2GX 2015.

Track: Big Data

Speaker: Marius Bogoevici

Slides: http://www.slideshare.net/SpringCentral/stream-processing-at-scale-with-spring-xd-and-kafka

Build and launch faster with Okta’s user management API. Register today for the free forever developer edition!

Topics:
spring

Published at DZone with permission of Pieter Humphrey, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}