Big Data Resources

Reading AWS S3 File Content to Kafka Topic

How to Read S3 files to Kafka topic using CamelAWSS3SourceConnector.

September 3, 2020

by Ramu kakarla

· 12,332 Views · 3 Likes

Apache Kafka and SAP ERP Integration Options

Integration of Apache Kafka and SAP systems. Overview and Trade-offs of APIs, SDKs, Tools, Kafka Connect Connectors for ECC, S4/Hana, other SAP apps.

Updated August 31, 2020

by Kai Wähner

CORE

· 15,964 Views · 8 Likes

Apache Kafka Is Not for Event Sourcing

Apache Kafka is great for delivering messages, but if you're using it for event sourcing—think again. Learn about why Kafka isn't suitable for event sourcing.

August 28, 2020

by Jesper Hammarbäck

· 20,725 Views · 8 Likes

Tutorial: Data Ingestion From Kafka to Azure Data Explorer

Use the Azure Data Explorer sink connector to ingest data from Apache Kafka.

August 26, 2020

by Abhishek Gupta

CORE

· 7,070 Views · 6 Likes

Writing .NET Core Application’s Log Into ElasticSearch With NLog

See how we can take advantage of NLog and ElasticSearch to better track and manage your .NET application's logs.

Updated August 25, 2020

by Matt Ghafouri

· 22,251 Views · 4 Likes

Using PostgreSQL pgoutput Plugin for Change Data Capture With Debezium

In this article, see a quick walkthrough on how to use the PostgreSQL pgoutput plugin for change data capture with Debezium.

August 21, 2020

by Abhishek Gupta

CORE

· 18,574 Views · 4 Likes

Why you Should and How to Archive your Kafka Data to Amazon S3

Move data from Apache Kafka to AWS S3 with Kafka Connect in order to reduce storage cost and have a Kafka data recovery option.

August 21, 2020

by Stefan Bocutiu

· 17,628 Views · 5 Likes

Top 5 Apache Kafka Courses for Beginners and Experienced Developers

A discussion of five online courses you can use to begin your journey with Apache Kafka and what you can expect to learn from each of the courses.

Updated August 20, 2020

by Javin Paul

· 39,966 Views · 18 Likes

Top 5 JavaScript Libraries to Create an Organizational Chart

Here are five options with a range of capabilities, customizations, and price points to begin building your organizational chart.

Updated August 20, 2020

by Ivan Petrenko

· 211,025 Views · 14 Likes

Salesforce Change Data Capture Streaming Data With Kafka and Snowflake Data Warehouse

In our tutorial, we are going to demonstrate how Salesforce Orders can be sent to the event bus and pushed them into a Snowflake table in near real-time.

August 18, 2020

by Istvan Szegedi

· 10,216 Views · 2 Likes

SQL Percentile Aggregates and Rollups With PostgreSQL and t-digest

In this article, see how easy it is to aggregate and create SQL based percentile rollups with PostgreSQL and t-digest histograms.

August 13, 2020

by Matt Watson

· 9,711 Views · 1 Like

Processing Large Messages With Apache Kafka

Kafka wasn't built for large messages, but files and payloads keep getting bigger. This article covers use cases, architectures, and trade-offs with Kafka.

August 13, 2020

by Kai Wähner

CORE

· 49,687 Views · 4 Likes

Top 7 Security Measures for IoT Systems

In this article, take a look at seven crucial steps for a business to uplift IoT security for preventing a data breach.

August 12, 2020

by Mohit Shah

· 13,295 Views · 2 Likes

Low Code Serverless Integration With Kafka

In this article, we will build out a scenario of publishing messages from AWS Lambda to a Kafka topic.

Updated August 12, 2020

by Pranav K

CORE

· 6,790 Views · 4 Likes

Spring Boot and Kafka Configuration Tuning

See a setup for configuration tuning in an isolated environment and to determine the Spring Boot, Kafka configuration and best practices for moderate uses.

August 11, 2020

by Amit Rathi

· 94,113 Views · 10 Likes

Kafka on Kubernetes, the Strimzi Way! (Part 4)

In this part, we will configure persistence for our Kafka cluster

August 7, 2020

by Abhishek Gupta

CORE

· 10,328 Views · 6 Likes

How to Properly Leverage Elasticsearch and User Behavior Analytics for API Security

How to set up Elasticsearch and Kibana for User Behavior Analytics (UBA) in API Security Monitoring — Accurately identify API security vulnerabilities.

August 6, 2020

by Derric Gilling

CORE

· 7,576 Views · 6 Likes

Moving Toward Smarter Data: Graph Databases and Machine Learning

A brief overview of database solutions, an introduction to using machine learning and graph databases, and real-world use cases for putting context back into your data.

August 5, 2020

by Frank Eaves

· 25,048 Views · 20 Likes

Best Practices for Digital Twin Implementation

The possibilities of what you can do with digital twin technology are only as limited as your imagination

August 5, 2020

by Rachel Roundy

· 12,928 Views · 3 Likes

How to Make Chatbots More Intelligent With Contextual Intelligence

Are you looking for ways to make your chatbots more intelligent? Read here how Contextual Intelligence can help.

Updated August 4, 2020

by Amit Dua

· 8,027 Views · 5 Likes

The Latest Big Data Topics