Data Resources

Scaling InfluxDB for High-Volume Reporting With Continuous Queries (CQs)

In this article, we improved InfluxDB query performance by using Continuous Queries to pre-aggregate high-volume Kafka data for faster, efficient reporting.

April 29, 2025

by Venkata Ashok Kumar Boyina

· 3,350 Views · 3 Likes

On-Call That Doesn’t Suck: A Guide for Data Engineers

Data pipelines don’t fail silently; they make a lot of noise. The question is, are you listening to the signal or drowning in noise?

April 29, 2025

by Tulika Bhatt

· 3,339 Views · 3 Likes

How To Replicate Oracle Data to BigQuery With Google Cloud Datastream

Set up Oracle 19c to BigQuery replication using Google Cloud Datastream, covering prerequisites, networking, CDC setup, and job validation.

April 29, 2025

by Karteek Kotamsetty

· 19,117 Views · 3 Likes

Doris: Unifying SQL Dialects for a Seamless Data Query Ecosystem

Apache Doris breaks this barrier with its powerful SQL dialect compatibility and builds a unified data query ecosystem for users.

April 28, 2025

by Darren Xu

· 3,412 Views

Thermometer Continuation in Scala

Implement thermometer continuations in Scala using exceptions and state to capture, replay, and resume control flow with minimal changes to the language.

April 25, 2025

by Michael Wang

· 4,617 Views · 1 Like

Clean Up Event Data in Ansible Event-Driven Automation

Clean and normalize event data in Ansible Event-Driven Automation (EDA) with the ansible.eda.dashes_to_underscores filter for smoother, more reliable automation.

April 25, 2025

by Binoj Melath Nalinakshan Nair

CORE

· 6,509 Views · 5 Likes

Power BI Embedded Analytics — Part 1: Introduction and Power BI Authoring Overview

Introduction to embedded analytics with Power BI. Covers the basics, helping you kickstart your journey into leveraging embedded analytics for informed decision-making.

April 24, 2025

by Robin Rizvi

CORE

· 3,779 Views · 2 Likes

Scaling in Practice: Caching and Rate-Limiting With Redis and Next.js

Redis powers both caching (to speed up API responses) and rate limiting (to prevent faucet abuse), offering performance improvements and protecting against abuse.

April 24, 2025

by Ernest Nnamdi

· 6,475 Views · 2 Likes

CRDTs Explained: How Conflict-Free Replicated Data Types Work

Explore Conflict-free Replicated Data Types. Data structure designed to ensure that data on different replicas will eventually converge into a consistent state.

April 24, 2025

by Bartłomiej Żyliński

CORE

· 6,293 Views · 2 Likes

Apache Doris vs Elasticsearch: An In-Depth Comparative Analysis

Apache Doris excels in complex analytics with SQL support and high performance, while Elasticsearch is ideal for full-text search and real-time retrieval.

April 23, 2025

by Michael Hayden

· 4,913 Views · 2 Likes

Stateless vs Stateful Stream Processing With Kafka Streams and Apache Flink

Concepts and benefits of stateless and stateful stream processing with Kafka Streams and Apache Flink vs. databases and data lakes.

April 21, 2025

by Kai Wähner

CORE

· 7,094 Views · 4 Likes

Thumbnail Generator Microservice for PDF in Spring Boot

Build a utility Spring Boot microservice that converts PDF documents to PNG thumbnails with the open-source Apache PDFBox package.

April 21, 2025

by Amol Gote

CORE

· 3,111 Views · 1 Like

Why I Built the Ultimate Text Comparison Tool (And Why You Should Try It)

Learn how my comprehensive text comparison tool combines exact, fuzzy, and phonetic matching to solve your messiest data reconciliation challenges in minutes.

April 17, 2025

by Mokhtar Ebrahim

· 4,301 Views · 3 Likes

Enhancing Avro With Semantic Metadata Using Logical Types

Avro logical types add semantic meaning to primitive data types, making schemas more expressive. This blog explores their benefits and common use cases.

April 16, 2025

by Gurmeet Saran

· 6,607 Views · 2 Likes

Securing Parquet Files: Vulnerabilities, Mitigations, and Validation

Parquet files are widely used in big data ecosystems, but vulnerabilities like CVE-2025-30065 highlight the importance of secure handling.

April 15, 2025

by Vamshidhar Morusu

· 6,034 Views · 1 Like

Emerging Data Architectures: The Future of Data Management

This article explores the latest advancements in data architecture, focusing on frameworks and newer paradigms such as LakeDB and zero ETL architectures.

April 15, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 7,933 Views · 10 Likes

A Deep Dive into Apache Doris Indexes

Apache Doris offers various index types, each designed for specific needs. Let’s delve into their features and discover what drives their exceptional performance.

April 14, 2025

by Darren Xu

· 6,177 Views

How Doris + Hudi Turned the Impossible Into the Everyday

Want to know how this "data giant ship" navigates the waves? Follow this article to uncover the amazing story of Doris and Hudi, the "dream team" of data.

April 14, 2025

by Zen Hua

· 5,855 Views · 4 Likes

Transforming Data Analytics by Combining SQL and ML

Learn how AI and ML extend SQL's capabilities for advanced analytics, predictive insights, and query optimization, transforming database interactions.

April 10, 2025

by Ramalakshmi Murugan

· 5,545 Views · 2 Likes

Java UDFs and Stored Procedures for Data Engineers: A Hands-On Guide

See how to build Java-based stored procedures and UDFs in Snowflake using Snowpark APIs for scalable, efficient data workflows, including async processing and file handling.

April 10, 2025

by Fawaz Ghali, PhD

CORE

· 7,236 Views · 3 Likes

The Latest Data Topics