Big Data Resources

Apache Kafka’s Built-In Command Line Tools

I want to highlight the five scripts/tools that I believe will have the biggest influence on your development work, mostly related to real-time data stream processing.

August 21, 2023

by Gautam Goswami CORE

· 2,125 Views · 2 Likes

Logging Incoming Requests in Spring WebFlux

Enter the realm of logging input requests in Spring WebFlux, a critical foundation for both diagnosing issues and ensuring application security.

August 21, 2023

by Dursun Koç CORE

· 5,271 Views · 2 Likes

Platform Analytics

From Google Analytics to deep-dive data analytics for your APIs, big data matters when it comes to understanding your company. Learn about platform analytics.

August 21, 2023

by Lawrence Ebringer CORE

· 1,932 Views · 1 Like

Unveiling Kafka-Streams-Cassandra-State-Store

'Drop-in' Kafka Streams State Store implementation that persists data to Apache Cassandra / ScyllaDB. Stateless to run, no changelog, no state restore.

August 21, 2023

by Hartmut Armbruster

· 4,296 Views · 1 Like

Why the Manufacturing Sector Needs Edge Computing

Manufacturers need to embrace edge computing in order to keep up with Industry 4.0. As technology continues to advance, manufacturers need fast and efficient solutions.

August 19, 2023

by Devin Partida

· 3,329 Views · 1 Like

Data Streaming From Smart Factory to Cloud

Real-time synchronization between the Smart Factory and cloud applications with reliable Data Streaming powered by Apache Kafka, e.g., BMW.

August 18, 2023

by Kai Wähner CORE

· 3,138 Views · 2 Likes

Seeing the Forest for the Trees: Data Preservation Starts With a Keen Eye

Initiating a successful data preservation strategy hinges on the foundation of meticulous observation and an unwavering focus on details.

August 18, 2023

by Michael Chukwube

· 3,875 Views · 2 Likes

Edge Data Platforms, Real-Time Services, and Modern Data Trends

This article will explore what edge data platforms and real-time services are, why they are important, and how they can be used.

August 18, 2023

by Margo McCabe

· 4,605 Views · 2 Likes

IoT in the Cloud: 8 Key Benefits and How to Get Started

Cloud-based IoT platforms are transforming industries all over the world. Check some of the key benefits of integrating IoT devices with cloud-based platforms.

August 18, 2023

by Weihong Zhang

· 3,715 Views · 1 Like

Function Calling: Integrate Your GPT Chatbot With Anything

Exploring OpenAI's GPT new function calling feature, allowing chatbots to interact with external tools and APIs. Unlock the potential of AI-powered applications.

August 18, 2023

by Tomas Fernandez

· 4,135 Views · 1 Like

ETL vs. ELT

It may be difficult to discern the differences between ETL and ELT. While similar in appearance, the acronyms refer to different approaches to moving and processing data

August 17, 2023

by Brett Hansen

· 2,004 Views · 1 Like

Reactive Event Streaming Architecture With Kafka, Redis Streams, Spring Boot, and HTTP Server-Sent Events (SSE)

A guide to streaming events from Kafka to Redis, using SSE to ensure only relevant events are processed and sent to individual client IDs.

August 17, 2023

by Greg Lawson

· 5,528 Views · 7 Likes

How To Level Up in Your Data Engineering Role

Data engineering is one of the fastest-growing jobs in tech. Here’s how to get the role — and grow in your data engineering career.

August 17, 2023

by Shadi Rostami

· 2,175 Views · 3 Likes

Choosing an OLAP Engine for Financial Risk Management: What To Consider?

This post provides reference for what you should take into account when choosing an OLAP engine in a financial scenario.

August 16, 2023

by Frank Z

· 1,603 Views · 1 Like

Building a Real-Time IoT Application With Solace Technology

The article explores the importance of real-time data in IoT applications and how Solace's messaging platform facilitates data communication between IoT devices.

August 16, 2023

by Kingsley Amankwah

· 1,669 Views · 3 Likes

Take Your Data Science Career to the Next Level With SDS™ Certification: A Complete Guide

SDS™ credential holders demonstrate the expertise to work across various industries and organizations at any stage of their careers.

August 15, 2023

by Anamika Singh

· 1,317 Views · 1 Like

ELT Is Dead, and EtLT Will Be the End of Modern Data Processing Architecture

In this article, discuss why EtLT is gradually replacing ETL and ELT as the global mainstream data processing architecture.

August 15, 2023

by Zongwen Li

· 2,769 Views · 1 Like

Integration Testing of Non-Blocking Retries With Spring Kafka

How to write integration tests for your Spring Kafka implementation of consumers having retries and Dead Letter Publishing enabled.

August 14, 2023

by Mukut Bhattacharjee

· 3,154 Views · 7 Likes

IIoT Explained: Examples, Technologies, Benefits, and Challenges

IIoT is a key component of Industry 4.0, the fourth industrial revolution, characterized by the fusion of digital, physical, and biological technologies.

August 12, 2023

by Li Guowei

· 3,785 Views · 2 Likes

Decoupling Storage and Compute: Have We Gone Too Far?

The latest innovations in the data engineering industry revolve around how different data platforms are coupling or decoupling storage and compute. Is it too much?

August 12, 2023

by Shane Murray

· 4,221 Views · 3 Likes

The Latest Big Data Topics