Big Data Resources

IoT and Energy Management: Optimizing Efficiency and Sustainability

Discover how IoT is changing energy management, optimizing efficiency, and sustainability. Learn smart energy strategies to cut costs and reduce waste.

May 18, 2023

by Shikhar Deopa

· 2,705 Views · 1 Like

Apache Kafka vs. Message Queue: Trade-Offs, Integration, Migration

Message broker vs. data streaming — trade-offs, integration, and migration scenarios from JMS, IBM MQ, TIBCO, or ActiveMQ to Apache Kafka.

May 18, 2023

by Kai Wähner

CORE

· 4,402 Views · 2 Likes

Beyond SCADA: Consolidating Your OT With an IIoT Platform

Along with MES, SCADA is today’s most widely used system in manufacturing facilities. So why does an industrial IoT platform still make sense here?

May 18, 2023

by Zornitsa Dimitrova

· 2,865 Views · 1 Like

How To Design Reliable IIoT Architecture

Refining your IIoT design is a key part of building strong cybersecurity resilience in the network architecture. Here's how to add security to every layer.

May 18, 2023

by Emily Newton

· 3,530 Views · 2 Likes

Why `fsync()`: Losing Unsynced Data on a Single Node Leads to Global Data Loss

Regardless of the replication mechanism, you must fsync() your data to prevent global data loss in non-Byzantine protocols.

May 18, 2023

by Denis Rystsov

· 2,472 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 5,492 Views · 2 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 1,921 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 46,884 Views · 6 Likes

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,550 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,321 Views · 3 Likes

Global Supply Chain With Kafka and IoT

Transforming global supply chain with data streaming and IoT for end-to-end visibility and decision-making in real-time at BMW, Bosch, and Walmart.

May 12, 2023

by Kai Wähner

CORE

· 6,243 Views · 2 Likes

Enriching Kafka Applications With Contextual Data

Kafka is great for event streaming architectures, continuous data integration (ETL), and messaging systems of record (database). Learn how to enhance your Kafka applications.

May 12, 2023

by Fawaz Ghali, PhD

CORE

· 6,678 Views · 4 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,007 Views · 2 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 8,044 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 5,199 Views · 2 Likes

Have ChatGPT Scrape Your Website

A lot of people want to have ChatGPT scrape their website. In this article, I will explain how our ChatGPT website scraper works.

May 10, 2023

by Thomas Hansen

CORE

· 2,942 Views · 3 Likes

Developing Metadata-Driven Data Engineering Pipelines Using Apache Spark and Python Dictionary

This article will discuss metadata-driven programming techniques to make our PySpark code more flexible, maintainable, and reusable.

May 10, 2023

by Amlan Patnaik

· 4,459 Views · 4 Likes

Top Data Science Courses to Consider

In this article, we will read about the top 7 Data Science Certification Courses along with their price, mode of education course curriculum, and other basic stuff.

May 9, 2023

by Sarang S Babu

· 2,149 Views · 1 Like

Ways To Stop and Resume Your Kafka Producer/Consumer at Run-Time

In this blog, the reader will learn how to stop and resume a Kafka client or producer at runtime using two distinct methods.

May 9, 2023

by Ashok Gudise

· 5,182 Views · 1 Like

Understanding Kafka and Event-Driven Architecture [Video Tutorials]

Explore Kafka and Event Driven Architecture, covering key concepts such as consumer groups, topic partitions, replication, and cluster workings.

May 9, 2023

by Ram N

· 3,314 Views · 2 Likes

The Latest Big Data Topics