Akka Streams and Kafka Streams: Where Microservices Meet Fast Data
Learn about Akka Streams and Kafka Streams for addressing the requirements of availability, scalability, and resilience for streaming microservices and Fast Data.
by
Join the DZone community and get the full member experience.
Join For FreeWhy Microservices and Fast Data Belong Together
In a recent Lightbend survey, 75% of over 2,400 developers reported having at least some real-time functionality in their systems. Enterprises are realizing that the ability to extract value from streaming data in near real-time is the new competitive advantage.
Two technologies, Akka Streams and Kafka Streams, have emerged as popular tools to use with Apache Kafka for addressing the shared requirements of availability, scalability, and resilience for both streaming microservices and Fast Data. So which one should you use for specific use cases?
While both tools are part of Lightbend Fast Data Platform, they were designed for different needs and use cases: Akka Streams emerged as a dataflow-centric abstraction for the Akka Actor model, designed for general-purpose microservices, very low-latency event processing, and support for a wider class of application problems and third-party integrations via Alpakka. Kafka Streams, by comparison, is purpose-built for reading data from Kafka topics, processing it, and writing the results to new topics in a Kafka-centric way.
In this webinar by Dr. Dean Wampler, O'Reilly author and VP of Fast Data Engineering at Lightbend, we will:
- Discuss the strengths and weaknesses of Akka Streams and Kafka Streams for particular design needs in data-centric microservices, including code examples from our Kafka Streams with Akka Streams tutorial.
- Contrast them with Spark Streaming and Flink, which provide richer analytics over potentially huge data sets
- Help you map these streaming engines to your specific use cases, so you confidently pick the right ones for your projects
Watch the full cideo + Q&A (56 min.):
Additional Resources to Enjoy
An Introduction to Fast Data: Get The Free O'Reilly eBook Fast Data Architectures for Streaming Applications
Legacy System & Cloud Integrations With Alpakka: Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google Cloud
What to Know About Using Apache Kafka: Putting Kafka In Jail - Best Practices To Run Kafka On Kubernetes & DC/OS
Lightbend Fast Data Platform (PDF): Download our Fast Data Platform technical overview to learn more about our easy-on ramp for designing, building, and running streaming and Fast Data applications
Published at DZone with permission of Oliver White, DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.
Comments