Big Data Resources

Apache Kafka vs. Message Queue: Trade-Offs, Integration, Migration

Message broker vs. data streaming — trade-offs, integration, and migration scenarios from JMS, IBM MQ, TIBCO, or ActiveMQ to Apache Kafka.

May 18, 2023

by Kai Wähner

CORE

· 5,433 Views · 2 Likes

Beyond SCADA: Consolidating Your OT With an IIoT Platform

Along with MES, SCADA is today’s most widely used system in manufacturing facilities. So why does an industrial IoT platform still make sense here?

May 18, 2023

by Zornitsa Dimitrova

· 3,239 Views · 1 Like

How To Design Reliable IIoT Architecture

Refining your IIoT design is a key part of building strong cybersecurity resilience in the network architecture. Here's how to add security to every layer.

May 18, 2023

by Emily Newton

· 4,482 Views · 2 Likes

Why `fsync()`: Losing Unsynced Data on a Single Node Leads to Global Data Loss

Regardless of the replication mechanism, you must fsync() your data to prevent global data loss in non-Byzantine protocols.

May 18, 2023

by Denis Rystsov

· 2,886 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 6,442 Views · 2 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 2,628 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 49,733 Views · 6 Likes

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,899 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,856 Views · 3 Likes

Global Supply Chain With Kafka and IoT

Transforming global supply chain with data streaming and IoT for end-to-end visibility and decision-making in real-time at BMW, Bosch, and Walmart.

May 12, 2023

by Kai Wähner

CORE

· 6,680 Views · 2 Likes

Enriching Kafka Applications With Contextual Data

Kafka is great for event streaming architectures, continuous data integration (ETL), and messaging systems of record (database). Learn how to enhance your Kafka applications.

May 12, 2023

by Fawaz Ghali, PhD

CORE

· 7,244 Views · 4 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,427 Views · 2 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 10,363 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 5,975 Views · 2 Likes

Have ChatGPT Scrape Your Website

A lot of people want to have ChatGPT scrape their website. In this article, I will explain how our ChatGPT website scraper works.

May 10, 2023

by Thomas Hansen

CORE

· 3,617 Views · 3 Likes

Developing Metadata-Driven Data Engineering Pipelines Using Apache Spark and Python Dictionary

This article will discuss metadata-driven programming techniques to make our PySpark code more flexible, maintainable, and reusable.

May 10, 2023

by Amlan Patnaik

· 5,823 Views · 4 Likes

Top Data Science Courses to Consider

In this article, we will read about the top 7 Data Science Certification Courses along with their price, mode of education course curriculum, and other basic stuff.

May 9, 2023

by Sarang S Babu

· 2,805 Views · 1 Like

Ways To Stop and Resume Your Kafka Producer/Consumer at Run-Time

In this blog, the reader will learn how to stop and resume a Kafka client or producer at runtime using two distinct methods.

May 9, 2023

by Ashok Gudise

· 6,415 Views · 1 Like

Understanding Kafka and Event-Driven Architecture [Video Tutorials]

Explore Kafka and Event Driven Architecture, covering key concepts such as consumer groups, topic partitions, replication, and cluster workings.

May 9, 2023

by Ram N

· 4,263 Views · 3 Likes

How To Boost AI Model Training With a Distributed Storage System

Learn why distributed storage is important in the AI field and how JuiceFS, an open-source, high-performance distributed file system, can help boost model training.

May 8, 2023

by Changjian Gao

· 3,799 Views · 2 Likes

The Latest Big Data Topics