Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Putting Kafka in Jail: Best Practices to Run Kafka on Kubernetes and DC/OS [Video]

DZone's Guide to

Putting Kafka in Jail: Best Practices to Run Kafka on Kubernetes and DC/OS [Video]

Learn how to reliably run Kafka in container orchestrated clusters and reduce the overhead for a number of common operational tasks.

· Big Data Zone ·
Free Resource

How do you break a Monolith into Microservices at Scale? This ebook shows strategies and techniques for building scalable and resilient microservices.

If you’ve worked with Kafka, then you may have discovered that it’s best suited to run on bare metal on dedicated machines, and in statically defined clusters.

But for many of us, this isn’t convenient for utilizing the full scope of our resources, like mixed-use containers with orchestration technologies like DC/OS and/or Kubernetes, and on-premise, hybrid and cloud infrastructures.

So what can you do about it? Maybe it's time to put Kafka in jail.

In this webinar by Sean Glover (@seg1o), Fast Data Engineer at Lightbend, we will review leading Kafka implementations on DC/OS and Kubernetes to see how they reliably run Kafka in container orchestrated clusters and reduce the overhead for a number of common operational tasks with standard cluster resource manager features. You will learn specifically about concerns like:

  • The need for greater operational knowhow to do common tasks with Kafka in static clusters, such as applying broker configuration updates, upgrading to a new version, and adding or decommissioning brokers.
  • The best way to provide resources to stateful technologies while in a mixed-use cluster, noting the importance of disk space as one of Kafka’s most important resource requirements.
  • How to address the particular needs of stateful services in a model that natively favors stateless, transient services.

Video


Slides

How do you break a Monolith into Microservices at Scale? This ebook shows strategies and techniques for building scalable and resilient microservices.

Topics:
big data ,apache kafka ,kubernetes ,dcos

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}