Big Data Resources

Migrating Apache Flume Flows to Apache NiFi: Kafka Source to Multiple Sinks

How-to move off of legacy Flume and into modern Apache NiFi for data pipelines.

October 15, 2019

by Tim Spann

CORE

· 19,172 Views · 9 Likes

PySpark Join Explained

Everything you need to know about PySpark's Join method.

October 14, 2019

by Monika Rathor

· 185,638 Views · 8 Likes

Kafka With Spring Cloud Stream

Everything you need to get started with Kafka's Spring Cloud Stream.

October 8, 2019

by Nakul Shukla

· 60,669 Views · 14 Likes

How to Set Up a Data Lake Architecture With AWS

Get started with your data lake with AWS.

October 7, 2019

by Gaurav Mishra

· 29,998 Views · 6 Likes

Life Beyond Kafka With Apache Pulsar

Moving on — finding love after Kafka.

October 4, 2019

by Avaro Santos Andres

· 81,972 Views · 52 Likes

Three Challenges That Impact Successful Data Pipelines

Big Data projects could account for 25 percent or more of IT budgets this year.

October 2, 2019

by Kunal Agarwal

· 8,123 Views · 2 Likes

The Normalization Spectrum

Let's take a look at the data normalization spectrum.

October 2, 2019

by Perry Krug

· 12,965 Views · 5 Likes

ETL Process: How You Can Design And Implement It Effectively

Implement and design ETL fast and effectively.

October 1, 2019

by Chris Bateson

· 7,968 Views · 2 Likes

Machine Learning in Software Development — Use Cases

There is a diversity of use cases in a wide variety of industries.

September 27, 2019

by Tom Smith

CORE

· 12,431 Views · 1 Like

Machine Learning in Software Development — Techniques and Tools

The ability to version-control ML models, automate testing, and provide better feedback.

September 26, 2019

by Tom Smith

CORE

· 9,508 Views · 2 Likes

DataOps: Leveraging DevSecOps Principles for Secure Data Analytics

Better data security delivered faster.

September 23, 2019

by Shahin Mohammadkhani

· 9,173 Views · 4 Likes

Top 10 Real-World Artificial Intelligence Applications

Explore the top ten real-world AI applications and the various fields these applications have impacted.

September 18, 2019

by Zulaikha Geer

· 31,712 Views · 6 Likes

Graph Algorithms, Neural Networks, and Graph Databases. The Year of the Graph Newsletter, September 2019

Let's explore graph algorithms, neural networks, and graph databases in this newsletter.

September 18, 2019

by George Anadiotis

· 8,701 Views · 3 Likes

Using Jakarta EE/MicroProfile to Connect to Apache Kafka: Part Two

No existentialism here — get grounded with Kafka and Jakarta EE.

September 13, 2019

by Otavio Santana

CORE

· 12,340 Views · 7 Likes

Best Practices for Event-Driven Microservice Architecture

Do you do them all?

September 11, 2019

by Jason Skowronski

· 49,504 Views · 28 Likes

How to Prepare for Your DevOps Interview

Here's the interview prep you should conduct to be ready for the DevOps hotseat.

Updated September 11, 2019

by John Taylor

· 52,421 Views · 15 Likes

Take a Deep Dive Into the Kafka Producer API

This article teaches us about the Kafka Producer API and demonstrates how to construct a Kafka producer.

September 10, 2019

by Jashan Goyal

· 24,612 Views · 10 Likes

Apache Kafka, KSQL, and Apache PLC4X for Industrial IoT and Automation

Learn more about IIoT automation with Apache Kafka, KSQL, and Apache PLC4X.

September 6, 2019

by Kai Wähner

CORE

· 18,328 Views · 6 Likes

Kafka Tutorial: Generate Multiple Consumer Groups Dynamically With Spring-Kafka

Generate multiple consumer groups in minutes with Spring-Kafka.

Updated September 6, 2019

by Murat Derman

· 41,388 Views · 8 Likes

Big Data Case Study: Zhihu's 1.3 Trillion Rows of Data, Milliseconds of Response Time

1.3 trillion rows of data, milliseconds of response time.

September 4, 2019

by Xiaoguang Sun

· 25,127 Views · 15 Likes

The Latest Big Data Topics