Jean-Paul Azar

Engineering at Cloudurable

Dublin, US

Joined Feb 2017

http://cloudurable.com/

About

Focused on Cassandra running in EC2. Monitoring, deployment, etc. Writing monitoring and install code in Bash and Go lang. Using Docker, Vagrant, VirtualBox, Packer, EC2, and various other tools.

Stats

Reputation:	958
Pageviews:	1.5M
Articles:	13
Comments:	6

Articles
Comments

Articles

What Is Kafka? Everything You Need to Know

Kafka is often used in real-time streaming data architectures to provide real-time analytics. Learn its specific use cases and why it's exploding in popularity.

Updated June 21, 2022

· 310,229 Views · 102 Likes

Kafka, Avro Serialization, and the Schema Registry

Learn what the Schema Registry is and how you're losing out if you're not using it with Kafka for schema evolution, serialization, and deserialization.

September 15, 2017

· 233,227 Views · 11 Likes

Using Avro for Big Data and Data Streaming Architectures: An Introduction

Avro provides fast, compact data serialization. Get tips for using it with Kafka and Hadoop, learn about schemas in Avro, and more.

September 14, 2017

· 20,228 Views · 5 Likes

Writing a Kafka Consumer in Java

Learn about constructing Kafka consumers, how to use Java to write a consumer to receive and process records, and the logging setup.

September 1, 2017

· 251,986 Views · 17 Likes

Kafka Architecture: Log Compaction

This article on Kafka architecture talks goes over Kafka design and log compaction, its structure, and the log compaction process.

August 31, 2017

· 46,926 Views · 11 Likes

Kafka Detailed Design and Ecosystem

Learn about the design of the Kafka ecosystem: Kafka Core, Kafka Streams, Kafka Connect, Kafka REST Proxy, and the Schema Registry.

August 29, 2017

· 25,909 Views · 14 Likes

Understanding Kafka Failover

This Kafka tutorial aims to help you understand failover for brokers and consumers; you'll run a consumer to test and prove Kafka's consumer failover.

August 23, 2017

· 46,243 Views · 12 Likes

Kafka Consumer Architecture - Consumer Groups and Subscriptions

In this installment, learn about Kafka consumer architecture, consumer groups, how record processing is shared, and failover for consumers.

August 19, 2017

· 56,343 Views · 12 Likes

Kafka Producer Architecture - Picking the Partition of Records

This article covers Kafka Producer Architecture, including how a partition is chosen, producer cadence, partitioning strategies, and consumers.

August 18, 2017

· 68,769 Views · 12 Likes

Kafka Topic Architecture - Replication, Failover, and Parallel Processing

Digging deeper into Kafka architecture, this article covers the details of replication, failover, and parallel processing in this data pipeline software.

August 17, 2017

· 96,023 Views · 29 Likes

Kafka Producer in Java

This detailed tutorial will help you create a simple Kafka producer, which allows you to publish records to the Kafka cluster.

August 10, 2017

· 107,180 Views · 14 Likes

Kafka Architecture

Learn about the architecture and functionality of Kafka, the software for building real-time streaming data pipelines, in this comprehensive primer.

August 9, 2017

· 134,711 Views · 86 Likes

Setting Up a Cassandra Cluster With SSL

If compliance and security are a concern, you can set up Cassandra clusters with encryption in mind using SSL while ensuring nodes can still communicate with each other.

February 8, 2017

· 19,974 Views · 17 Likes

Comments

Writing a Kafka Consumer in Java

Sep 17, 2017 · Jean-Paul Azar

True. Thanks.

Kafka Topic Architecture - Replication, Failover, and Parallel Processing

Sep 13, 2017 · Jean-Paul Azar

You are welcome! :)

Kafka Producer Architecture - Picking the Partition of Records

Aug 28, 2017 · Jean-Paul Azar

It is a turn of phrase. More accurate would be not on the same partition, offset.

Kafka Consumer Architecture - Consumer Groups and Subscriptions

Aug 28, 2017 · Jean-Paul Azar

Have you checked any metrics? Are there retries?

What Is Kafka? Everything You Need to Know

Aug 15, 2017 · Jean-Paul Azar

I am working on a project that is using NiFi. Or will be in a later phase. I have not worked much with HortonWorks HDF platform. For Kafka, our clients often spin up their own clusters and we have a few that use Confluent.

What Is Kafka? Everything You Need to Know

Aug 15, 2017 · Jean-Paul Azar

Tim I have not tried that yet. Thanks for writing. I will check it out.