Big Data Resources

Data Processing in GCP With Apache Airflow and BigQuery

Efficient data processing is paramount. In this guide, we'll explore how to leverage Apache Airflow and BigQuery to create robust and scalable data pipelines.

March 20, 2024

by Sreenath Devineni

CORE

· 15,141 Views · 5 Likes

The Data Streaming Landscape 2024

This article presents a comparison of open-source Apache Kafka and Flink stream processing products, cloud, competition, and market trends.

March 20, 2024

by Kai Wähner

CORE

· 8,743 Views · 2 Likes

PostgresML: Streamlining AI Model Deployment With PostgreSQL Integration

By embracing PostgresML, organizations can tap into the power of AI-driven insights and gain a competitive edge in today's data-centric landscape.

March 20, 2024

by Pankaj Zanke

· 10,012 Views · 2 Likes

The Impact of Biometric Authentication on User Privacy and the Role of Blockchain in Preserving Secure Data

Blockchain technology is a novel solution to privacy concerns and risks associated with the storage and maintenance of biometric data.

March 20, 2024

by Saurav Bhattacharya

· 6,027 Views · 2 Likes

The Power of AI: Building a Robust Data Ecosystem for Enterprise Success

The article emphasizes the importance of building a comprehensive data ecosystem for enterprises, covering key principles, critical components, and value drivers for success.

March 19, 2024

by Siddharth Rajagopal

· 9,231 Views · 3 Likes

ChatGPT Code Smell [Comic]

What is that smell? In this latest comic from Daniel Stori, discover the result of ChatGPT-generated code.

March 19, 2024

by Daniel Stori

CORE

· 3,998 Views · 2 Likes

Kafka Message Filtering: An Analysis

An analysis of how to implement a Kafka message filtering strategy, first as a general approach, then with the consumer needing to recover after deserialization errors.

March 19, 2024

by Horatiu Dan

· 3,978 Views · 1 Like

Breaking Down Data Silos With a Unified Data Warehouse: An Apache Doris-Based CDP

An insurance company uses Apache Doris in replacement of Spark+Impala+HBase+NebulaGraph, in their Customer Data Platform for 4 times faster customer grouping.

March 19, 2024

by Shirley H.

· 7,724 Views · 2 Likes

Building a Sustainable Data Ecosystem

Generative AI brings innovation, but it also brings challenges in privacy, fairness, and accountability in data sharing.

March 15, 2024

by Chidumga Izuzu

· 6,212 Views · 6 Likes

How to Setup RAID10 on Dell Servers

Understanding different types of storage configurations is important and today we will discuss how we can achieve redundancy and performance by using RAID arrays.

March 15, 2024

by Prashanth Ravula

CORE

· 6,434 Views · 5 Likes

Data Lake vs. Data Warehouse: 10 Key Differences

In this article, learn more about the ten major differences between data lakes and data warehouses to make the best choice.

March 14, 2024

by Waris Husain

· 3,900 Views · 1 Like

MQTT Market Trends for 2024: Cloud, Unified Namespace, Sparkplug, Kafka Integration

Market trends for MQTT: Data Governance with Unified Namespace and Sparkplug B, OPC-UA Debates, and Integration with Apache Kafka for OT/IT.

March 13, 2024

by Kai Wähner

CORE

· 3,155 Views · 1 Like

CRUDing NoSQL Data With Quarkus, Part Two: Elasticsearch

Part 2 of this series focuses on Elasticsearch, a distributed NoSQL database and search engine built on Apache Lucene.

March 12, 2024

by Nicolas Duminil

CORE

· 8,565 Views · 1 Like

Taming the Tiny Titan: Database Solutions for RAM-Constrained IoT Devices

In this article, the author provides a comprehensive and informative overview of RAM-friendly databases for IoT devices.

March 12, 2024

by Aditya Bhuyan

· 3,718 Views · 2 Likes

When a Data Mesh Doesn’t Make Sense for Your Organization

Data mesh—including data mesh governance—requires the right mix of process, tooling, and internal resources. Find out what it takes to get data mesh-ready.

March 11, 2024

by Lior Gavish

· 3,114 Views · 1 Like

Streaming Real-Time Data From Kafka 3.7.0 to Flink 1.18.1 for Processing

Flink seamlessly integrates with Kafka and offers robust support for exactly-once semantics, ensuring each event is processed precisely once. Learn more here.

March 10, 2024

by Gautam Goswami

CORE

· 11,155 Views · 2 Likes

Solix Empowers the Data-Driven Enterprise With Comprehensive Data Management and Integration Solutions

How Solix helps data-driven enterprises manage and integrate data to get more value for more people with less time and less money.

March 9, 2024

by Tom Smith

CORE

· 6,246 Views · 1 Like

Python in Urban Planning

This article explores the role of Python in urban planning, highlighting its importance in leveraging data analysis and programming for sustainable city development.

March 8, 2024

by Konstantin Berezin

· 11,888 Views · 1 Like

Introduction to Modern Data Stack

Exploring how the modern data stack revolutionizes data management with scalable cloud solutions, automated tools, and advanced analytics capabilities.

March 8, 2024

by Suhas Jangoan

· 5,364 Views · 5 Likes

Data Management in Distributed Systems: A Comprehensive Exploration of Open Table Formats

This article emphasizes the revolutionary effect of open table formats on data management practices in distributed computing landscapes.

March 7, 2024

by Anandaganesh Balakrishnan

· 3,917 Views · 4 Likes

The Latest Big Data Topics