Data Resources

The 4 R’s of Pipeline Reliability: Designing Data Systems That Last

In this article, learn how the 4 R’s — robust architecture, resumability, recoverability, and redundancy — enhance reliability in AI and ML data pipelines.

May 1, 2025

by Sidhant bendre

· 4,077 Views · 2 Likes

Fixing Common Oracle Database Problems

In this article, we will discuss the issues we commonly face while working with Oracle databases and explore ways to solve them.

April 30, 2025

by Dhaval Patolia

· 5,433 Views · 1 Like

Setting Up Data Pipelines With Snowflake Dynamic Tables

This is a walkthrough of the process for building an automated data pipeline with dynamic table capabilities in Snowflake for various refresh frequencies.

April 30, 2025

by Prasath Chetty Pandurangan

· 4,199 Views

Develop a Reverse Proxy With Caching in Go

Learn to build a caching reverse proxy in Go with the standard library, featuring HTTP forwarding, in-memory caching with TTL, and compression handling.

April 30, 2025

by Rez Moss

· 2,339 Views · 2 Likes

Building Scalable and Resilient Data Pipelines With Apache Airflow

Learn to build scalable, fault-tolerant, and observable data pipelines with Apache Airflow, focusing on real-time insights and custom reporting for enterprise SaaS.

April 30, 2025

by Ramya K R Vuyyuru

· 3,147 Views · 1 Like

The Modern Data Stack Is Overrated — Here’s What Works

The modern data stack is overrated. What works? Fewer tools, clear ownership, and systems your team actually understands.

April 29, 2025

by Rahul .

· 3,325 Views · 1 Like

Scaling InfluxDB for High-Volume Reporting With Continuous Queries (CQs)

In this article, we improved InfluxDB query performance by using Continuous Queries to pre-aggregate high-volume Kafka data for faster, efficient reporting.

April 29, 2025

by Venkata Ashok Kumar Boyina

· 2,579 Views · 3 Likes

On-Call That Doesn’t Suck: A Guide for Data Engineers

Data pipelines don’t fail silently; they make a lot of noise. The question is, are you listening to the signal or drowning in noise?

April 29, 2025

by Tulika Bhatt

· 2,616 Views · 1 Like

How To Replicate Oracle Data to BigQuery With Google Cloud Datastream

Set up Oracle 19c to BigQuery replication using Google Cloud Datastream, covering prerequisites, networking, CDC setup, and job validation.

April 29, 2025

by Karteek Kotamsetty

· 17,732 Views · 3 Likes

Doris: Unifying SQL Dialects for a Seamless Data Query Ecosystem

Apache Doris breaks this barrier with its powerful SQL dialect compatibility and builds a unified data query ecosystem for users.

April 28, 2025

by Darren Xu

· 2,619 Views

Thermometer Continuation in Scala

Implement thermometer continuations in Scala using exceptions and state to capture, replay, and resume control flow with minimal changes to the language.

April 25, 2025

by Michael Wang

· 4,137 Views · 1 Like

Clean Up Event Data in Ansible Event-Driven Automation

Clean and normalize event data in Ansible Event-Driven Automation (EDA) with the ansible.eda.dashes_to_underscores filter for smoother, more reliable automation.

April 25, 2025

by Binoj Melath Nalinakshan Nair

CORE

· 5,876 Views · 5 Likes

The Role of Functional Programming in Modern Software Development

Functional programming enhances modern software development with cleaner code, better scalability, and improved maintainability.

April 24, 2025

by Michael Chukwube

· 6,281 Views · 3 Likes

Power BI Embedded Analytics — Part 1: Introduction and Power BI Authoring Overview

Introduction to embedded analytics with Power BI. Covers the basics, helping you kickstart your journey into leveraging embedded analytics for informed decision-making.

April 24, 2025

by Robin Rizvi

CORE

· 2,760 Views · 2 Likes

Scaling in Practice: Caching and Rate-Limiting With Redis and Next.js

Redis powers both caching (to speed up API responses) and rate limiting (to prevent faucet abuse), offering performance improvements and protecting against abuse.

April 24, 2025

by Ernest Nnamdi

· 4,874 Views · 2 Likes

CRDTs Explained: How Conflict-Free Replicated Data Types Work

Explore Conflict-free Replicated Data Types. Data structure designed to ensure that data on different replicas will eventually converge into a consistent state.

April 24, 2025

by Bartłomiej Żyliński

CORE

· 5,421 Views · 2 Likes

Apache Doris vs Elasticsearch: An In-Depth Comparative Analysis

Apache Doris excels in complex analytics with SQL support and high performance, while Elasticsearch is ideal for full-text search and real-time retrieval.

April 23, 2025

by Michael Hayden

· 3,743 Views · 1 Like

Stateless vs Stateful Stream Processing With Kafka Streams and Apache Flink

Concepts and benefits of stateless and stateful stream processing with Kafka Streams and Apache Flink vs. databases and data lakes.

April 21, 2025

by Kai Wähner

CORE

· 6,324 Views · 4 Likes

Thumbnail Generator Microservice for PDF in Spring Boot

Build a utility Spring Boot microservice that converts PDF documents to PNG thumbnails with the open-source Apache PDFBox package.

April 21, 2025

by Amol Gote

CORE

· 2,056 Views · 1 Like

Why I Built the Ultimate Text Comparison Tool (And Why You Should Try It)

Learn how my comprehensive text comparison tool combines exact, fuzzy, and phonetic matching to solve your messiest data reconciliation challenges in minutes.

April 17, 2025

by Mokhtar Ebrahim

· 3,845 Views · 3 Likes

The Latest Data Topics