Big Data Resources

Building A Log Analytics Solution 10 Times More Cost-Effective Than Elasticsearch

Inverted indexing in Apache Doris 2.0.0 realizes two times faster log query performance than Elasticsearch with 1/5 of the storage space it uses.

May 19, 2023

by Shirley H.

· 5,405 Views · 4 Likes

Expert Guide to Data Transformation Tool

Data aggregation, data cleansing, data mapping, and data transformation techniques in combination are essential for all businesses, regardless of size.

May 19, 2023

by Scott Johnny

· 3,709 Views · 1 Like

Which Is Better for IoT: Azure RTOS or FreeRTOS?

IoT needs speed, reliability, and energy efficiency that isn’t guaranteed in a desktop environment. Let's look at how to choose the right real-time operating system.

May 19, 2023

by Carsten Rhod Gregersen

· 9,732 Views · 1 Like

Connect Snowflake to BigQuery: Two Easy Methods

The article outlines two methods for connecting Snowflake and BigQuery: the Snowflake connector and various third-party ETL tools.

May 19, 2023

by Chisom Ndukwu

· 11,033 Views · 1 Like

IoT and Energy Management: Optimizing Efficiency and Sustainability

Discover how IoT is changing energy management, optimizing efficiency, and sustainability. Learn smart energy strategies to cut costs and reduce waste.

May 18, 2023

by Shikhar Deopa

· 3,100 Views · 1 Like

Apache Kafka vs. Message Queue: Trade-Offs, Integration, Migration

Message broker vs. data streaming — trade-offs, integration, and migration scenarios from JMS, IBM MQ, TIBCO, or ActiveMQ to Apache Kafka.

May 18, 2023

by Kai Wähner

CORE

· 5,388 Views · 2 Likes

Beyond SCADA: Consolidating Your OT With an IIoT Platform

Along with MES, SCADA is today’s most widely used system in manufacturing facilities. So why does an industrial IoT platform still make sense here?

May 18, 2023

by Zornitsa Dimitrova

· 3,214 Views · 1 Like

How To Design Reliable IIoT Architecture

Refining your IIoT design is a key part of building strong cybersecurity resilience in the network architecture. Here's how to add security to every layer.

May 18, 2023

by Emily Newton

· 4,394 Views · 2 Likes

Why `fsync()`: Losing Unsynced Data on a Single Node Leads to Global Data Loss

Regardless of the replication mechanism, you must fsync() your data to prevent global data loss in non-Byzantine protocols.

May 18, 2023

by Denis Rystsov

· 2,849 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 6,374 Views · 2 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 2,579 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 49,640 Views · 6 Likes

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,863 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,799 Views · 3 Likes

Global Supply Chain With Kafka and IoT

Transforming global supply chain with data streaming and IoT for end-to-end visibility and decision-making in real-time at BMW, Bosch, and Walmart.

May 12, 2023

by Kai Wähner

CORE

· 6,644 Views · 2 Likes

Enriching Kafka Applications With Contextual Data

Kafka is great for event streaming architectures, continuous data integration (ETL), and messaging systems of record (database). Learn how to enhance your Kafka applications.

May 12, 2023

by Fawaz Ghali, PhD

CORE

· 7,195 Views · 4 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,384 Views · 2 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 10,209 Views · 8 Likes