Big Data Resources

Implementing a CDC Performance Feature With the Help of ChatGPT

Discover how a QA engineer leveraged ChatGPT's AI capabilities to implement a performance feature for TiCDC, a change data capture solution for TiDB.

May 2, 2023

by Sidney Chen

· 3,566 Views · 1 Like

Unlocking the Power of Explainable AI With 5 Popular Python Frameworks

Discover how to get the most out of Explainable AI with the help of five popular Python frameworks. Learn how to uncover hidden patterns in data.

May 2, 2023

by Jennifer Wales

· 4,290 Views · 1 Like

Building Event-Streaming Applications in .NET

in this post, we introduce how to use .NET Kafka clients along with the Task Parallel Library to build a robust, high-throughput event streaming application.

May 2, 2023

by Bill Bejeck

· 1,996 Views · 2 Likes

Optimizing ETL Workflows: Trends, Challenges, and Best Practices for DataOps Success

Master the future of data: Unleash the power of effective ETL workflow with DataOps insights, best practices, and game-changing strategies.

May 2, 2023

by Chisom Ndukwu

· 4,198 Views · 1 Like

Leveraging IoT for Water Resource Management

Water resource management is the need of the hour, and conventional methods are not going to be enough. Hence IoT and analytics have to be incorporated into the system.

May 1, 2023

by Kamal R

· 3,330 Views · 1 Like

Orange Pi Cluster With Docker Swarm and MariaDB

In this article, I’ll show you how to build a (surprisingly cheap) 4-node cluster packed with 16 cores and 4GB RAM to deploy a MariaDB replicated topology.

May 1, 2023

by Alejandro Duarte

CORE

· 26,691 Views · 7 Likes

What Is Deep Data Observability?

Deep data observability is truly comprehensive in terms of data sources, data formats, data granularity, validator configuration, cadence, and user focus.

May 1, 2023

by Patrik Liu Tran

· 3,947 Views · 3 Likes

Getting Started With Redpanda in Kubernetes

Learn how Redpanda is deployed in K8s with components like the reimplementation of Kafka broker, StatefulSets, nodeport, persistent storage, and observability.

May 1, 2023

by Christina Lin

CORE

· 6,517 Views · 4 Likes

Java Consumer and Producer Messages Between Kafka Server [Video Tutorials]

This video tutorial series explores the procedure of sending and receiving messages between a Java consumer and producer and the Apache Kafka server.

April 28, 2023

by Ram N

· 8,649 Views · 2 Likes

ChatGPT as a Revolution

In this blog, the reader will learn how ChatGPT came into existence, its history, the working of GPT, and be presented with use cases.

April 28, 2023

by Shashank Gupta

· 7,179 Views · 3 Likes

How ChatGPT Writes Code for Automation Tool Cypress

ChatGPT may be used to write code in a variety of programming languages and technologies. After more investigation, I made the decision to create some scenarios using it.

April 28, 2023

by Kailash Pathak

CORE

· 9,553 Views · 2 Likes

User Data Governance and Processing Using Serverless Streaming

This article delves into the concept of User Data Governance and its implementation using serverless streaming in the digital age.

April 27, 2023

by Maharshi Jha

· 6,432 Views · 4 Likes

7 Essential Data Quality Tests

Getting started with data quality testing? Here are the 7 must-have checks to improve data quality and ensure reliability for your most critical assets.

April 27, 2023

by Lior Gavish

· 4,663 Views · 2 Likes

Delta, Hudi, and Iceberg: The Data Lakehouse Trifecta

Get a detailed overview of Delta Lake, Apache Hudi, and Apache Iceberg as we discuss their data storage, processing capabilities, and deployment options.

April 26, 2023

by Andrey Gusarov

· 11,579 Views · 4 Likes

Frequently Faced Challenges in Implementing Spark Code in Data Engineering Pipelines

This article discusses some of the common challenges faced by data engineers in Pyspark applications and the possible solutions to overcome these challenges.

April 25, 2023

by Amlan Patnaik

· 6,983 Views · 2 Likes