Over a million developers have joined DZone.

Kafka Possibly Moving to Java CRC, Akka Suggested

· Java Zone

Learn more about Kotlin, a new programming language designed to solve problems that software developers face every day brought to you in partnership with JetBrains.

If you haven't heard of Kafka, a super-fast distributed message queue from LinkedIn, you probably ought to look into it, and its heavily involved Apache incubator community.

Not to go too far into minutiae, but just today there was some talk about moving to a Java-based CRC32.  Kafka is written in Scala, but the good thing is that if they used a Java CRC it wouldn't need to be modified.  

One developer also suggested using Akka Actors "as they can provide the necessary ordering guarantees, do not require thread pool tuning, and should be easy to reason about. The performance would likely be better than producer/consumer thread chains too, since chained actors often run in the same thread and avoid processor cache thrashing."

Another community member had this to say:
Akka seems a bit overkill for this (although it does have some nice properties). It would be interesting to refactor the threading in Kafka with Akka and see what kind of performance differences there are. -Kafka project page

Kafka is definitely worth checking out and getting involved with if you are a Java or Scala developer.  If not Kafka, maybe you should join another open source project.  It's getting close to the end of the year so it's time to set some new goals!  Or not .

The Java Zone is brought to you in partnership with JetBrains.  Discover how powerful static code analysis and ergonomic design make development not only productive but also an enjoyable experience.


{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}