KSQL Deep Dive — The Open Source Streaming SQL Engine for Apache Kafka

DZone 's Guide to

KSQL Deep Dive — The Open Source Streaming SQL Engine for Apache Kafka

Read on to learn more about the KSQL Deep Dive workshop. See the agenda, view slides, and watch a video recording on it.

· Database Zone ·
Free Resource

I had a workshop at Kafka Meetup Tel Aviv in May 2018: "KSQL Deep Dive — The Open Source Streaming Engine for Apache Kafka".

Here is the agenda, the slides, and the video recording.

KSQL - The Open Source Streaming SQL Engine for Apache Kafka

KSQL is the open-source, Apache 2.0 licensed streaming SQL engine on top of Apache Kafka, which aims to simplify all this and make stream processing available to everyone. Even though it is simple to use, KSQL is built for mission-critical and scalable production deployments (using Kafka Streams under the hood).
Benefits of using KSQL include No coding required, no additional analytics cluster needed, streams and tables as first-class constructs, and access to the rich Kafka ecosystem. This session introduces the concepts and architecture of KSQL. Use cases such as Streaming ETL, Real-Time Stream Monitoring, or Anomaly Detection are discussed. A live demo shows how to setup and use KSQL quickly and easily on top of your Kafka ecosystem.

If you want to get started, try out the KSQL quick start guide. It gets you started in ten minutes locally on your laptop or alternatively in a Docker environment.

History of Apache Kafka, Confluent, and KSQL


  1. Apache Kafka Ecosystem
  2. Kafka Streams as Foundation for KSQL
  3. Motivation for KSQL
  4. KSQL Concepts
  5. Live Demo #1 – Intro to KSQL
  6. KSQL Architecture
  7. Live Demo #2 - Clickstream Analysis
  8. Building a User Defined Function (Example: Machine Learning)
  9. Getting Started


You can find the slides here.

Video Recording

There was a Youtube live stream. Unfortunately, we had some technical problems. So the audio of the first half is not really good. Sorry for that, but I still want to share it. The second half has good sound quality:

Looking forward to getting your feedback. Also, please feel free to ask questions in the Confluent Slack community (where you can also get help from the engineers of KSQL) or create Github tickets if you have problems or contributions to this great open source project.

apache kafka, big data, confluent, database, kafka, kafka streams, ksql, sql, stream processing, streaming analytics

Published at DZone with permission of Kai Wähner , DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}