Data Resources

Learn about how GenAI automates ETL pipelines, generates code, adapts to schema changes, and improves data processes with speed, efficiency, and precision.

February 14, 2025

by Ramesh Daddala

· 6,667 Views · 3 Likes

Idempotency in Distributed Systems: When and Why It Matters

This article explains idempotency in distributed systems and ensuring consistent results regardless of multiple executions, with implementation and challenges.

February 13, 2025

by Sandeep Kumar Gond

· 5,850 Views

Goose Migrations for Smooth Database Changes

Migrate safely: Goose automates DB changes, version control, and rollbacks. Minimal downtime — ideal for CI/CD and high load.

February 12, 2025

by Ilia Ivankin

· 10,378 Views

The Right ETL Architecture for Multi-Source Data Integration

Dedicated ETL pipelines are easy to set up but hard to scale, while common pipelines offer efficiency at the cost of complexity. Know which one to choose.

February 12, 2025

by Murat Balkan

CORE

· 6,457 Views · 2 Likes

A Comprehensive Guide to Building and Debugging Apache Doris

Learn how to compile and debug Apache Doris from source. This guide also covers setup, dependencies, troubleshooting, and debugging tips for developers.

February 12, 2025

by Michael Hayden

· 5,111 Views · 2 Likes

USA PATRIOT Act vs SecNumCloud: Which Model for the Future?

The USA PATRIOT Act grants U.S. data access abroad, while French SecNumCloud secures European sovereignty. The challenge: balancing security and sovereignty.

February 12, 2025

by Frederic Jacquet

CORE

· 5,265 Views · 1 Like

System Design of an Audio Streaming Service

In this article, we will go over the audio streaming system and key design considerations to address functional and non-functional requirements.

February 11, 2025

by Gitanjali Sahoo

· 7,157 Views · 4 Likes

SQL as the Backbone of Big Data and AI Powerhouses

SQL powers Big Data and AI with tools like BigQuery, remaining a cornerstone of data-driven innovation through its simplicity and adaptability.

February 11, 2025

by Medha Gupta

· 3,828 Views · 2 Likes

Perfecting CRUD Functionality in NextJS

CRUD operations are essential for data management. Learn how to manage data processing, React Query, pagination, and more efficiently with insights and examples.

February 11, 2025

by Olena Vlasenko

· 6,757 Views · 5 Likes

Indexed View for Aggregating Metrics

In this article, we will learn how to utilize the Indexed View capability of Azure SQL Server for tuning query performance and reducing latency.

February 10, 2025

by Ankur Peshin

· 4,632 Views · 1 Like

SQL Dynamic Data Masking for Privacy and Compliance

SQL Server Dynamic Data Masking helps protect sensitive data by obscuring it from non-privileged users, ensuring compliance with GDPR, HIPAA, and PCI-DSS.

February 10, 2025

by Dorababu Nadella

· 5,356 Views · 1 Like

Control Your Services With OTEL, Jaeger, and Prometheus

In this article, we will combine OTEL, Jaeger, and Prometheus for faster, centralized observability and quick troubleshooting in distributed systems.

February 7, 2025

by Ilia Ivankin

· 5,562 Views · 4 Likes

Data Management With PostgreSQL Partitioning and pg_partman

PostgreSQL table partitioning divides large tables into smaller segments to boost query performance, simplify maintenance, and enable scalable data management.

February 7, 2025

by arvind toorpu

CORE

· 4,343 Views · 1 Like

Best Practices for Scaling Kafka-Based Workloads

Kafka is a famous technology with a lot of great features and capabilities. This article explains Kafka producer and consumer configurations best practices.

February 6, 2025

by Narendra Lakshmana gowda

· 6,241 Views · 2 Likes

How Spring Boot Starters Integrate With Your Project

The article provides an overview of Spring Boot starters, which are pre-packaged sets of dependencies that simplify adding functionality to Spring Boot applications.

February 5, 2025

by Taras Ivashchuk

· 6,245 Views · 3 Likes

The Role of DQ Checks in Data Pipelines

Why are DQ checks critical for every data pipeline, and what are some of the different types of DQ alerts you can set up to enhance the reliability of your pipeline?

February 5, 2025

by Ajay Krishnan Prabhakaran

· 5,739 Views · 1 Like