Data Engineering Resources

Building a Retrieval-Augmented Generation (RAG) System in Java With Spring AI, Vertex AI, and BigQuery

Build a Java RAG application using Spring Boot, Vertex AI embeddings, BigQuery vector search, and a web UI for interactive PDF-based question answering.

November 24, 2025

by Mohammed Fazalullah Qudrath

· 6,611 Views · 8 Likes

Creating an MCP Client With Spring AI

This blog post outlines the creation of an MCP client using Spring AI, building upon a previously established MCP server.

November 24, 2025

by Gunter Rotsaert

CORE

· 4,307 Views · 2 Likes

The Right to Be Forgotten in Event-Driven Data Products

Using event sourcing to propagate deletes across the data mesh for consistent retention and right-to-be-forgotten compliance.

November 24, 2025

by Murat Balkan

CORE

· 1,426 Views · 2 Likes

Architectural Evidence in Enterprise Java: Making Domain-Driven Design Visible

Use CDI stereotypes + JMolecules annotations to make DDD architecture explicit, enforceable, and testable. This preserves design intent as your Java system evolves.

November 24, 2025

by Otavio Santana

CORE

· 5,871 Views · 4 Likes

Building Multimodal Agents with Google ADK — Practical Insights from My Implementation Journey

AI agents have rapidly evolved to support non-text inputs, unlocking new use cases and enabling seamless human-AI collaboration.

November 21, 2025

by Aakash Sharma

· 3,204 Views · 1 Like

Revolutionizing Supply Chain Optimization with AI-Driven Constraint Programming

AI-driven constraint programming integrates machine learning with optimization to create adaptive, real-time, and efficient supply chain management.

November 21, 2025

by Shrinivas Jagtap

· 1,993 Views · 1 Like

Software Testing in the AI Era - Evolving Beyond the Pyramid

Rethinking the canonical three-tiered software testing pyramid and software quality assurance strategies in the decade of AI

November 21, 2025

by Surbhi Madan

· 2,169 Views · 3 Likes

Deploying a Serverless Application on Google Cloud

Deploy a Python serverless app on Google Cloud Functions with ease. Learn setup, deployment steps, best practices, and how to secure and optimize your function.

November 20, 2025

by Neel Shah

· 2,842 Views · 3 Likes

Advanced Usage of Decodable in Swift: Handling Dynamic Keys

Use DynamicKey to safely decode JSON with unpredictable keys — it avoids fragile if let chains and makes your decoding logic flexible and maintainable.

November 20, 2025

by Ada Kirsch

· 1,394 Views · 1 Like

Beyond Vector Databases: Integrating RAG as a First-Class Data Platform Workload

Architectural framework that integrates RAG deeply into enterprise data platforms through event-driven indexing, multi-layer hybrid retrieval, and governance by design.

November 20, 2025

by Anil kumar Kandalam

· 3,923 Views · 1 Like

Building Smarter Systems: Architecting AI Agents for Real-World Tasks

Event-driven agents use rules, not AI, to build scalable, reactive systems that automate tasks, boost resilience, and reduce complexity

November 20, 2025

by Vinod Veeramachaneni

· 2,046 Views

Iceberg Compaction and Fine-Grained Access Control: Performance Challenges and Solutions

Implementing fine-grained access control on Apache Iceberg can create major performance challenges. Learn how Glue, Redshift, and Athena handle FGAC at scale.

November 19, 2025

by Janani Annur Thiruvengadam

CORE

· 3,142 Views · 2 Likes

Zero Trust in API Gateways: Building Bulletproof Infrastructure With Istio and OPA

Traditional API security is broken. Perimeter defenses can't protect distributed microservices architectures where 83% of web traffic is now API-based.

November 19, 2025

by David Iyanu Jonathan

· 2,692 Views · 2 Likes

Creating an End-to-End ML Pipeline With Databricks and MLflow

This tutorial shows how to build a complete ML pipeline on Databricks using Delta Lake for data management and MLflow for model tracking, registration, and deployment.

November 19, 2025

by harshraj bhoite

· 3,015 Views · 1 Like

Smart AI Agent Targeting With MCP Tools

Transform your basic multi-agent system with business tiers, geographic targeting, and MCP tool integration using LaunchDarkly AI Configs.

November 19, 2025

by Scarlett Attensil

· 1,905 Views · 2 Likes

Meta Data: How Data about Your Data is Optimal for AI

Metadata enhances AI performance by providing crucial context for models. Learn key benefits, implementation strategies, and real-world examples for smarter AI systems.

November 19, 2025

by Kevin Vu

· 1,357 Views

From Zero to Local AI in 10 Minutes With Ollama + Python

In under ten minutes, install Ollama, pull a modern model, call it from Python or REST, and ship a repeatable Modelfile with a quick glance at the security checklist.

November 18, 2025

by Parthiban Rajasekaran

· 23,858 Views · 10 Likes

How to Create a Responsive Filter Component on React Guide

This guide walks developers through building a responsive filter component in React that adapts to both desktop and mobile views using dropdowns and modals.

November 18, 2025

by Chase Bolt

· 3,528 Views · 2 Likes

Building Gateway Analytics: My Journey to Making API Traffic Data Useful

Learn how to use OpenSearch to turn raw API gateway logs into insights, monitor performance, detect failures, and optimize distributed systems.

November 18, 2025

by Rihana Suhail

· 1,926 Views · 3 Likes

Embedding Ethics Into Multi-AI Agentic Self-Healing Data Pipelines

With this article, understand how to include ethical practices while developing a multi-agent generative AI framework for self-healing data pipelines.

November 18, 2025

by Naveen Kolli

· 2,199 Views · 1 Like

The Latest Data Engineering Topics