Big Data Resources

Big data offers potential, but trust issues arise from poor quality, security, and accuracy. Organizations need strategy, governance, and training to ensure reliability.

May 12, 2025

by Dilip Kumar Rachamalla

· 4,171 Views

Event-Driven Architectures: Designing Scalable and Resilient Cloud Solutions

Learn how to enhance scalability, resilience, and efficiency in cloud solutions using event-driven architectures with this step-by-step guide.

May 7, 2025

by Srinivas Chippagiri

CORE

· 20,753 Views · 4 Likes

Unlocking the Potential of Apache Iceberg: A Comprehensive Analysis

Organization adoption perspective and key considerations of Apache Iceberg, a high-performance open-source format for large analytic tables.

May 6, 2025

by Ram Ghadiyaram

CORE

· 5,214 Views · 6 Likes

AI, ML, and Data Science: Shaping the Future of Automation

AI, machine learning, and data science are transforming industries, driving automation, advancing innovation, and addressing challenges like data privacy and bias.

May 6, 2025

by Shafeeq Ur Rahaman

· 3,412 Views

Doris: Unifying SQL Dialects for a Seamless Data Query Ecosystem

Apache Doris breaks this barrier with its powerful SQL dialect compatibility and builds a unified data query ecosystem for users.

April 28, 2025

by Darren Xu

· 3,386 Views

Apache Doris vs Elasticsearch: An In-Depth Comparative Analysis

Apache Doris excels in complex analytics with SQL support and high performance, while Elasticsearch is ideal for full-text search and real-time retrieval.

April 23, 2025

by Michael Hayden

· 4,904 Views · 2 Likes

A Modern Stack for Building Scalable Systems

Dive into modern stack recommendations for building robust and scalable systems. This stack is agnostic and can be integrated into all programming languages.

April 23, 2025

by Bartłomiej Żyliński

CORE

· 8,899 Views · 2 Likes

Stateless vs Stateful Stream Processing With Kafka Streams and Apache Flink

Concepts and benefits of stateless and stateful stream processing with Kafka Streams and Apache Flink vs. databases and data lakes.

April 21, 2025

by Kai Wähner

CORE

· 7,072 Views · 4 Likes

Enhancing Avro With Semantic Metadata Using Logical Types

Avro logical types add semantic meaning to primitive data types, making schemas more expressive. This blog explores their benefits and common use cases.

April 16, 2025

by Gurmeet Saran

· 6,564 Views · 2 Likes

Securing Parquet Files: Vulnerabilities, Mitigations, and Validation

Parquet files are widely used in big data ecosystems, but vulnerabilities like CVE-2025-30065 highlight the importance of secure handling.

April 15, 2025

by Vamshidhar Morusu

· 6,000 Views · 1 Like

Emerging Data Architectures: The Future of Data Management

This article explores the latest advancements in data architecture, focusing on frameworks and newer paradigms such as LakeDB and zero ETL architectures.

April 15, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 7,901 Views · 10 Likes

A Deep Dive into Apache Doris Indexes

Apache Doris offers various index types, each designed for specific needs. Let’s delve into their features and discover what drives their exceptional performance.

April 14, 2025

by Darren Xu

· 6,102 Views

How Doris + Hudi Turned the Impossible Into the Everyday

Want to know how this "data giant ship" navigates the waves? Follow this article to uncover the amazing story of Doris and Hudi, the "dream team" of data.

April 14, 2025

by Zen Hua

· 5,840 Views · 4 Likes

AWS S3 Strategies for Scalable and Secure Data Lake Storage

Optimize your Amazon S3 data lake with strategic bucket configurations, data layers, encryption, and lifecycle policies for security, efficiency, and cost savings.

April 8, 2025

by Digvijay Waghela

· 6,990 Views

Optimizing Data Storage With Hybrid Partitioned Tables in Oracle 19c

Learn how to implement Hybrid Partitioned Tables (HPT) to streamline data management, boost query performance, and cut storage costs.

April 8, 2025

by arvind toorpu

CORE

· 4,094 Views · 3 Likes

Building a Cost-Effective ELK Stack for Centralized Logging

This tutorial covers the setup of a budget-friendly, secure, and scalable ELK logging platform using Infrastructure as Code (IaC) with Terraform and Ansible.

April 4, 2025

by Pradeep Kumar Goud Gaddamidi

· 9,446 Views · 5 Likes

Integrating Apache Doris and Hudi for Data Querying and Migration

Learn how to integrate Apache Doris with Apache Hudi for efficient federated querying, real-time analytics, and seamless data migration in big data environments.

April 3, 2025

by li yy

· 5,456 Views · 1 Like

Bridging OT and IT: IIoT Middleware for Edge and Cloud With Kafka and Flink

Explore how IIoT middleware and data streaming tools like Kafka and Flink bridge OT and IT, enabling real-time integration and smarter industrial operations.

April 2, 2025

by Kai Wähner

CORE

· 4,564 Views · 4 Likes

Building Scalable Data Lake Using AWS

Build a secure, scalable AWS data lake with S3, Glue, and Lake Formation, and learn key components, best practices, and analytics for optimized insights.

April 1, 2025

by Digvijay Waghela

· 4,625 Views · 3 Likes

Doris vs Elasticsearch: A Comparison and Practical Cost Case Study

Apache Doris excels in analytics, SQL support, and cost efficiency, while Elasticsearch leads in text search but has higher storage costs and complexity.

March 31, 2025

by Darren Xu

· 3,662 Views · 2 Likes

The Latest Big Data Topics