Data Engineering Resources

Long-Running Durable Agents With Spring AI and Dapr Workflows

Spring AI agentic patterns show how to coordinate multiple ChatClient calls to LLMs. We look at how Dapr Workflows can make these interactions durable and resilient.

October 10, 2025

by Mauricio Salatino

· 4,106 Views

Introduction to Spring Data Elasticsearch 5.5

Getting started with the latest version of Spring Data Elasticsearch 5.5 and Elasticsearch 8.18 as a NoSQL database for our data storage.

October 10, 2025

by Arnošt Havelka

CORE

· 2,976 Views · 2 Likes

Fixing a Test Involves Much More Than Simply Making It Pass

Learn why using Postman's 'Fix test' may mask bugs — tips to investigate failures, preserve test intent, and protect API reliability. Verify, then act.

October 10, 2025

by Stelios Manioudakis

CORE

· 4,736 Views · 3 Likes

AI-Assisted Kubernetes Diagnostics: A Practical Implementation

Proof-of-concept tool using GPT-4 to detect failing Kubernetes pods, analyze logs and events, and suggest fixes with human approval for common issues.

October 10, 2025

by Shamsher Khan

CORE

· 4,203 Views · 5 Likes

Building Realistic Test Data in Java: A Hands-On Guide for Developers

Learn how to build a simple API that delivers believable fake users, perfect for testing, demos, or UI prototyping. No more “John Doe” data, finally, real-feel mocks.

October 10, 2025

by Wallace Espindola

· 3,265 Views · 8 Likes

Using LLMs to Automate Root Cause Analysis in Incident Response

LLMs streamline incident response by quickly identifying root causes from logs and alerts, cutting down manual effort and downtime.

October 9, 2025

by Venkatesan Thirumalai

· 4,345 Views · 3 Likes

Evaluating LLM-Powered Voice Assistants: A Guide Beyond Traditional Metrics

A practical guide to evaluating LLM-powered voice assistants using multi-dimensional metrics covering helpfulness, accuracy, safety, and system performance.

October 9, 2025

by Surya Teja Appini

· 2,632 Views · 2 Likes

Building a Supply Chain Digital Twin Technology

Learn about digital twin technology using Python in supply chain management: model supply chain networks, enhance decision-making, and optimize operations.

October 9, 2025

by Manvinder Kumra

· 2,058 Views · 1 Like

How GenAI Can Eliminate SME Bottlenecks in Enterprise Systems

An AI-powered system, a knowledge-enabled system to explain enterprise code, reducing SME dependency and accelerating productivity.

October 9, 2025

by Monil Shah

· 1,687 Views · 3 Likes

Low Code, High Impact: A Solution Architect’s Guide to Building Scalable Community Platforms With AI and Low-Code Tools

How to build a modular, low-code community platform using Webflow, Supabase, AI-powered media generation, and Google Cloud Run.

October 9, 2025

by Rahul Ranjan

· 2,104 Views · 1 Like

Virtualization Meets Acceleration: Powering AI Workloads

AI doesn’t need new infrastructure — just smarter use of what you already have. Scale it securely and efficiently using your existing Cisco and VMware infrastructure.

October 9, 2025

by Siva Kiran Nandipati

· 2,884 Views · 1 Like

Efficiently Reading Large Excel Files (Over 1 Million Rows) Using the Open-Source Sjxlsx Java API

The primary objective of this article is to prevent the "out of memory-Java heap issue" when reading large Excel files using the open-source "sjxlsx" library.

October 9, 2025

by Mahendran Chinnaiah

· 6,813 Views · 7 Likes

The Top 20 Problems With Batch Processing (and How to Fix Them With Data Streaming)

20+ hidden issues with batch processing — like data loss, duplication, and latency — and why data streaming is the smarter solution.

October 8, 2025

by Kai Wähner

CORE

· 2,193 Views · 5 Likes

Transforming Your Node.js REST API into an AI-Ready MCP Server

Learn how to upgrade your Node.js REST API into an AI-ready MCP server to enable intelligent, agent-driven interactions.

October 8, 2025

by Lakshmi Narayana Rasalay

· 6,489 Views · 1 Like

8 Challenges in Multimodal Training Data Creation

Creating high-quality multimodal training data is essential yet complex, involving challenges in synchronization, scalability, context capture, and tooling.

October 8, 2025

by Chirag Shivalker

· 2,896 Views

The Agile AI Manifesto

This article discuss how the original Agile Manifesto anticipated the rise of AI — and why both AI maximalists and AI luddites misunderstand its true message.

October 8, 2025

by Stefan Wolpers

CORE

· 3,632 Views · 2 Likes

Pattern Searching and PostgreSQL Full-Text Search: Understanding the Mismatch

Learn why PostgreSQL full-text search (FTS) is great for semantic, language-aware searching, but not for raw pattern search.

October 7, 2025

by Horatiu Dan

CORE

· 3,885 Views · 11 Likes

Building Cost-Effective Internet Scale Applications

How cloud developers can build highly scalable applications with zero initial cost of running the infrastructure and scale them to millions of user requests.

October 7, 2025

by Ranjit Aneesh

· 3,536 Views · 2 Likes

Building a Production-Ready Conversational AI Agent With Cloudflare Workers and AI Gateway

Build a serverless chatbot with Cloudflare Workers for backend logic, AI Gateway for model routing, and KV for conversation history.

October 7, 2025

by Mayur Vekariya

· 3,807 Views · 1 Like

Dynamization of Static Data Structures

An intuitive explanation, along with some real-world applications of this forgotten 1980s technique for turning static data structures into dynamic ones.

October 7, 2025

by Pranet Verma

· 2,096 Views · 1 Like

The Latest Data Engineering Topics