Data Resources

Stream Processing on the Mainframe With Apache Flink: Genius or a Glitch in the Matrix?

Apache Flink on the IBM mainframe connects real-time processing with core systems, enabling hybrid cloud and AI without full migration.

September 10, 2026

by Kai Wähner

CORE

· 2,753 Views

Dashboards and Queries for Apache Kafka

Apache Kafka dashboards: when to use them, how to support different query types, and why a context engine often makes the difference.

September 10, 2026

by Kai Wähner

CORE

· 2,570 Views · 1 Like

How to Safely Deploy Control-Plane and Data-Plane Changes With Argo CD and Argo Rollouts

Safely deploy control- and data-plane changes with Argo CD, Argo Rollouts, health gates, traffic shifting, and rollback.

September 9, 2026

by Akhil Madineni

CORE

· 2,561 Views · 3 Likes

Dynamic Arrays, Spill, and LET: What Changed in Excel and Why It Matters for Java Applications

Modern Excel formulas change how spreadsheets work. See what Java developers need to know when choosing a spreadsheet library.

September 9, 2026

by Hawk Chen

CORE

· 3,448 Views · 2 Likes

Bringing Graph Analytics to Snowflake With Neo4j

Run Neo4j graph algorithms directly on your Snowflake data to uncover insights about connectivity, criticality, and failure impact that SQL alone can't easily surface.

September 9, 2026

by Akmal Chaudhri

CORE

· 2,370 Views

From ETL, ELT, and EtLT to Agent: What Is Changing in Enterprise Data Engineering?

Enterprise data engineering is evolving from fixed ETL and ELT pipelines toward EtLT and goal-driven agents, with Apache SeaTunnel as the execution layer.

September 8, 2026

by David Zollo

· 2,720 Views

Select AI and Vector Search on a Legacy Oracle Schema: What It Actually Takes

DBAs and developers managing Oracle schemas want to understand what integrating Select AI and vector search entails before applying it to critical systems.

September 7, 2026

by arvind toorpu

CORE

· 1,897 Views · 1 Like

Prompting AI for Analytics: The Missing Optimization Layer Between Your Question and the Model

A practical blueprint for cutting AI token costs in analytics — clean up the question before it reaches the model, then learn from what worked.

September 4, 2026

by Dinesh Pamcheti

· 2,526 Views

Your Spark Job Isn't Slow Because of Bad Code. It's Slow Because of the Wrong Join

Apache Spark job performance issues are frequently caused by improper join strategies leading to excessive data shuffling, rather than suboptimal code.

September 3, 2026

by Syed Siraj Mehmood

· 2,197 Views · 1 Like

Best Practices for Handling Bad Data in Stream Processing Platforms

Learn best practices for handling bad data in stream processing, from schema validation and duplicate detection to dead-letter queues, monitoring, and data lineage.

September 2, 2026

by Gautam Goswami

CORE

· 2,374 Views · 2 Likes

Ampere PMU Profiler: A Guide to Microarchitecture Profiling

APP uses PMU metrics to pinpoint CPU stalls, cache misses, and other microarchitectural bottlenecks on Ampere processors

September 1, 2026

by Bhakti Hinduja

· 2,865 Views · 2 Likes

Designing Replay-Safe CDC Pipelines With Kafka, Debezium, and Recovery Contracts

How to design CDC pipelines with Kafka, Debezium, idempotent writes, deterministic projections, replay workflows, reconciliation checks, and recovery evidence.

September 1, 2026

by Ishan Shah

· 3,080 Views · 1 Like

Stop Hardcoding Database Checks: Building a Metadata-Driven Data Quality Framework

Decouple validation from code. Learn how to build a dynamic, metadata-driven data quality framework using Databricks, Snowflake, and Python.

September 1, 2026

by Kshitish Nath

· 2,286 Views

Evolve or Automate: What It Actually Means to Be an AI-Native Data Engineer

The role isn't disappearing. But if you're still doing the same job you were doing two years ago, you're already behind.

September 1, 2026

by Janani Annur Thiruvengadam

CORE

· 3,618 Views · 1 Like

Designing a Dynamic Multi-Hierarchy Security Model for Analytics and Decision Support Systems

How we built row-level security across Workday HCM, Salesforce, Snowflake, Power BI, and Adaptive Planning that survives a reorganization.

August 31, 2026

by Yadi Reddy Mangannagari

· 2,532 Views · 1 Like

When "Roughly Right" Looks Like a Liability: Engineering Financial-Grade Data Pipelines

Learn how to build financial-grade pipelines using idempotent merges, hard-blocking dbt tests, and automated freshness alerts.

August 31, 2026

by Kiran Kumar Javangula

· 1,654 Views

Understanding RabbitMQ Exchange Types in Spring Boot

This blog delves into various RabbitMQ exchange types used within a Spring Boot application, highlighting examples and configurations.

August 26, 2026

by Gunter Rotsaert

CORE

· 2,808 Views · 2 Likes

Designing Rayfall: One Expression Language for a Columnar Database

How scalar evaluation, vector operations, lambdas, and relational queries can share one language without hiding expressions from the optimizer.

August 25, 2026

by Anton Kundenko

· 3,181 Views · 3 Likes

Stop Paying Your AI Agent to Do the Same Job Twice

Modern AI agent pipelines benefit significantly from a strategically positioned knowledge-base cache layer that sits upstream of the orchestration flow.

August 21, 2026

by Shivi Kashyap

· 2,916 Views · 2 Likes

Building Data Pipelines: Here's What Palantir Foundry Did That Surprised Me.

A senior data engineer's honest first impressions after a Palantir Foundry bootcamp: Five things to know before evaluating the platform.

August 18, 2026

by Sashank siwakoti

· 1,806 Views · 1 Like

The Latest Data Topics