DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Data Engineering Topics

article thumbnail
Building a Zero-Cost Approval Workflow With AWS Lambda Durable Functions
Learn how to build an ETL pipeline with human-in-the-loop approval that costs nothing while waiting — and see real cost data from processing 1,000 documents.
May 28, 2026
by Harpreet Siddhu
· 4,468 Views · 1 Like
article thumbnail
Your AI Agent Tests Are Passing, But Your Agent Is Still Broken
How to test AI agents that call tools — five patterns using traces and behavior contracts to catch bugs your current tests miss.
May 28, 2026
by Biresh Patel
· 2,624 Views
article thumbnail
Why Your DLP Policies Fall Short the Moment AI Agents Enter the Picture
AI agents have access, move at machine speed, and raise no alarms. Your DLP was built for humans — by the time it flags risk, the data is already gone.
May 28, 2026
by Priyanka Neelakrishnan
· 2,545 Views
article thumbnail
RAG Is Not Enough: Advanced Retrieval Architectures Using Vertex AI Search on GCP
Basic RAG breaks in production. Learn how hybrid retrieval, re-ranking, and metadata filtering enable reliable, production-grade GenAI systems.
May 28, 2026
by Abdul Rasheed Shaik
· 2,167 Views
article thumbnail
AI Paradigm Shift: Analytics Without SQL
An AI-native analytics agent sits between users and the data warehouse, translating natural-language questions into governed SQL or Python workflows and dashboards.
May 28, 2026
by Haricharan Shivram Suresh Chandra Kumar
· 2,383 Views
article thumbnail
Master-Class: Understanding Database Replication (Single, Multi, and Leaderless)
This article walks through the different database replication strategies, provides practical insights, identifies common pitfalls, and explains how to overcome them.
May 28, 2026
by Piyush Gupta
· 1,738 Views
article thumbnail
From AI Chaos to Control: Building Enterprise-Grade LLM Gateways With MuleSoft Anypoint
This article explains how an AI Gateway centralizes LLM access, enabling secure routing, governance, cost control, and visibility for scalable AI adoption.
May 28, 2026
by Jitendra Bafna
· 2,428 Views
article thumbnail
Ingesting Fixed-Width Mainframe Files Into Delta Lake: The Details Nobody Writes Down
Process mainframe fixed-width files by transcoding EBCDIC, extracting fields with Spark, decoding packed decimals, and validating data before loading to Delta Lake.
May 27, 2026
by Jeevan Krishna Paruchuri
· 2,567 Views
article thumbnail
Stateless JWT Auth Microservice Architecture With Spring Boot 3 and Redis Sentinel
Design a stateless JWT auth service with Spring Boot 3, Redis caching, and Sentinel for high availability, faster token validation, and reduced DB load.
May 27, 2026
by Erkin Karanlık
· 3,714 Views · 1 Like
article thumbnail
Stop Running Two Data Systems for One Agent Query
Most RAG pipelines coordinate a vector database and a structured lakehouse that don't share a transaction model. Here's how to fix that with a unified approach.
May 27, 2026
by Varun Srinivas
· 2,495 Views
article thumbnail
Feature Flag Debt: Performance Impact in Enterprise Applications
Feature flags help teams move fast, but when they’re not cleaned up, they quietly add extra code, slow down performance, and make applications harder to maintain.
May 27, 2026
by Poornakumar Rasiraju
· 4,137 Views · 1 Like
article thumbnail
Kafka and Spark Structured Streaming in Enterprise: The Patterns That Hold Up Under Pressure
The streaming patterns that survive in the enterprise are those built for scale, failure recovery, and long-term operability.
May 27, 2026
by Kuladeep Sandra
· 6,747 Views
article thumbnail
Programmatic Brand Extraction: Pulling Logos, Colors, and Assets from Any URL
OpenBrand is an open-source library that extracts structured brand assets from any URL - available as an npm package, API, or AI agent skill.
May 27, 2026
by Yixing Jiang
· 2,153 Views
article thumbnail
You Don't Get to Retrofit Trust: Why API Security Must Be Designed In, Not Bolted On
A field-level examination of how one startup got it right — and what the rest of the industry keeps getting catastrophically wrong.
May 27, 2026
by Igboanugo David Ugochukwu DZone Core CORE
· 3,224 Views
article thumbnail
Setting Up a Data Catalog With Azure Purview and Collibra: What Three Attempts Taught Me
Setting up a data catalog isn’t just a tool problem. My work with Azure Purview and Collibra showed success depends on governance, metadata, and adoption.
May 27, 2026
by Kuladeep Sandra
· 4,205 Views
article thumbnail
Architecting Zero-Trust AI Agents: How to Handle Data Safely
Transitioning AI agents from POC to production requires moving beyond permissive access to a zero-trust architecture. This covers the essential security layers.
May 26, 2026
by Felicia Thomson
· 6,014 Views · 3 Likes
article thumbnail
Exactly-Once Processing: Myth vs Reality
Exactly-once is a collection of local guarantees, not an end-to-end guarantee, and real systems rely on idempotency and at-least-once guarantees.
May 26, 2026
by Irullappan irulandi
· 2,687 Views · 2 Likes
article thumbnail
Bringing Intelligence Closer to the Source: Why Real-Time Processing is the Heart of Edge AI
Edge AI runs AI on devices for real-time decisions, cutting latency, boosting privacy, lowering costs, and working without internet for faster, reliable systems.
May 26, 2026
by Jitendra Bafna
· 2,877 Views
article thumbnail
Beyond Partitioning and Z-Order: A Deep Dive into Liquid Clustering for Unity Catalog Managed Tables
Liquid Clustering replaces rigid partitioning and Z-Order with adaptive clustering in Unity Catalog, improving performance with less maintenance.
May 26, 2026
by Seshendranath Balla Venkata
· 2,682 Views · 1 Like
article thumbnail
Building Enterprise-Grade Real-Time IoT Dashboards with Vue 3, MQTT, and Kafka
Event-driven architecture using MQTT (device communication) → Kafka (durable streams) → WebSocket (browser push) → Vue 3 (reactive UI).
May 26, 2026
by Venkata Sandeep Dhullipalla
· 2,220 Views
  • Previous
  • ...
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×