Big Data Resources

CQRS solves a very particular set of problems, like executing queries in event-stores or building web applications with extremely high scalability requirements.

Updated September 16, 2020

by Hristiyan Pehlivanov

· 45,823 Views · 49 Likes

EFK Stack on Kubernetes (Part 1)

This is the first post of a 2-part series where we will set up Kubernetes logging for applications deployed in the cluster and the cluster itself.

September 16, 2020

by Sudip Sengupta

CORE

· 6,030 Views · 3 Likes

Modern Cloud-Native Jakarta EE Frameworks: Tips, Challenges, and Trends.

Changes brought by cloud-native architecture impact applications in ways that weren't critical before.

Updated September 16, 2020

by Otavio Santana

CORE

· 3,996 Views · 2 Likes

Horizontally Scaling the Hive Metastore Database by Migrating From MySQL to TiDB

This post shows how TiDB helps Zhihu eliminate their database bottleneck and horizontally scale their Hive Metastore database to meet the growing business needs.

September 15, 2020

by mengyu hu

· 7,376 Views · 5 Likes

Accelerated Automatic Differentiation With JAX: How Does It Stack Up Against Autograd, TensorFlow, and PyTorch?

In this article, take a look at accelerated automatic differentiation with Jax and see how it stacks up against Autograd, TensorFlow, and PyTorch.

September 10, 2020

by Kevin Vu

· 10,802 Views · 2 Likes

How To Build a Real-Time, Event-Driven Information System

Building real-time information systems help enterprises to lead the pack and become competitive — learn how with WSO2 API Manager and Kafka

September 9, 2020

by Chanaka Fernando

CORE

· 11,960 Views · 3 Likes

Distributed Saga and Resiliency of Microservices

Eventual Consistency for Microservices using Distributed Saga.

Updated September 4, 2020

by Binildas Christudas

· 8,575 Views · 7 Likes

Reading AWS S3 File Content to Kafka Topic

How to Read S3 files to Kafka topic using CamelAWSS3SourceConnector.

September 3, 2020

by Ramu kakarla

· 11,736 Views · 3 Likes

Apache Kafka and SAP ERP Integration Options

Integration of Apache Kafka and SAP systems. Overview and Trade-offs of APIs, SDKs, Tools, Kafka Connect Connectors for ECC, S4/Hana, other SAP apps.

Updated August 31, 2020

by Kai Wähner

CORE

· 14,935 Views · 8 Likes

Apache Kafka Is Not for Event Sourcing

Apache Kafka is great for delivering messages, but if you're using it for event sourcing—think again. Learn about why Kafka isn't suitable for event sourcing.

August 28, 2020

by Jesper Hammarbäck

· 20,087 Views · 8 Likes

Tutorial: Data Ingestion From Kafka to Azure Data Explorer

Use the Azure Data Explorer sink connector to ingest data from Apache Kafka.

August 26, 2020

by Abhishek Gupta

CORE

· 6,497 Views · 6 Likes

Writing .NET Core Application’s Log Into ElasticSearch With NLog

See how we can take advantage of NLog and ElasticSearch to better track and manage your .NET application's logs.

Updated August 25, 2020

by Matt Ghafouri

CORE

· 21,757 Views · 4 Likes

Using PostgreSQL pgoutput Plugin for Change Data Capture With Debezium

In this article, see a quick walkthrough on how to use the PostgreSQL pgoutput plugin for change data capture with Debezium.

August 21, 2020

by Abhishek Gupta

CORE

· 17,118 Views · 4 Likes

Why you Should and How to Archive your Kafka Data to Amazon S3

Move data from Apache Kafka to AWS S3 with Kafka Connect in order to reduce storage cost and have a Kafka data recovery option.

August 21, 2020

by Stefan Bocutiu

· 16,565 Views · 5 Likes

Top 5 Apache Kafka Courses for Beginners and Experienced Developers

A discussion of five online courses you can use to begin your journey with Apache Kafka and what you can expect to learn from each of the courses.

Updated August 20, 2020

by Javin Paul

· 38,802 Views · 18 Likes

Top 5 JavaScript Libraries to Create an Organizational Chart

Here are five options with a range of capabilities, customizations, and price points to begin building your organizational chart.

Updated August 20, 2020

by Ivan Petrenko

· 203,876 Views · 14 Likes

Salesforce Change Data Capture Streaming Data With Kafka and Snowflake Data Warehouse

In our tutorial, we are going to demonstrate how Salesforce Orders can be sent to the event bus and pushed them into a Snowflake table in near real-time.

August 18, 2020

by Istvan Szegedi

· 9,420 Views · 2 Likes

SQL Percentile Aggregates and Rollups With PostgreSQL and t-digest

In this article, see how easy it is to aggregate and create SQL based percentile rollups with PostgreSQL and t-digest histograms.

August 13, 2020

by Matt Watson

· 9,025 Views · 1 Like

Processing Large Messages With Apache Kafka

Kafka wasn't built for large messages, but files and payloads keep getting bigger. This article covers use cases, architectures, and trade-offs with Kafka.

August 13, 2020

by Kai Wähner

CORE

· 48,094 Views · 4 Likes

Top 7 Security Measures for IoT Systems

In this article, take a look at seven crucial steps for a business to uplift IoT security for preventing a data breach.

August 12, 2020

by Mohit Shah

· 12,900 Views · 2 Likes

The Latest Big Data Topics