Data Engineering Resources

Your SDLC Has an Evil Twin — and AI Built It

AI coding is quietly building a “shadow SDLC” inside your organization, spinning up code, dependencies, configs, but requires solid best practices to prevent disaster.

September 19, 2025

by Eran Kinsbruner

· 6,305 Views · 4 Likes

Distributed Cloud-Based Dynamic Configuration Management

This article is about creating dynamic configurations and efficiently reloading them with a cache to avoid charges for excessive calls.

September 19, 2025

by Alankrit Kharbanda

· 3,282 Views · 1 Like

A Backend-First Approach to Production-Scale LLM Applications

A backend-first AI design with Laravel, queues, Redis, SSE, and MySQL powers resilience, scalability, and uninterrupted user experiences.

September 19, 2025

by Kolawole Yusuf

· 2,849 Views · 1 Like

VS Code Agent Mode: An Architect's Perspective for the .NET Ecosystem

The new agent mode in VS Code appears to be a disruption at first glance. Let's dive a bit deeper from an architect's perspective — from architecture to build.

September 19, 2025

by Shashi Kumar

· 3,653 Views · 2 Likes

7 API Integration Patterns: REST, gRPC, SSE, WS, and Queues

There are multiple API integration patterns. Today, I will compare seven of them across ten axes and dive deep into where they will shine.

September 19, 2025

by Bartłomiej Żyliński

CORE

· 2,633 Views · 3 Likes

Exploring Text-to-Cypher: Integrating Ollama, MCP, and Spring AI

Build an application for natural-language questions that an LLM converts to a Cypher query, runs against the database, and returns the query and the results.

September 19, 2025

by Jennifer Reif

CORE

· 2,117 Views · 4 Likes

LLMs for Debugging Code

Learn how LLMs can analyze code, assist in debugging workflows, and where their current limitations open space for future innovation.

September 18, 2025

by Surya Teja Appini

· 4,618 Views · 3 Likes

Blueprint for Agentic AI: Azure AI Foundry, AutoGen, and Beyond

Azure AI Foundry and AutoGen enable scalable, collaborative AI agents that automate complex tasks with minimal human effort.

September 18, 2025

by Anand Singh

· 4,081 Views · 1 Like

FOSDEM 2025 Recap: Open Source Contributors Unite to Collaborate and Help Advance Apache Software Projects

Apache Software Foundation participants shared observations from FOSDEM 25 to showcase some of the work that community members do for open-source software development.

September 18, 2025

by Brian Proffitt

· 1,566 Views

Unified Checkout Experience Through Micro Frontend Architecture

Learn about the architecture and design for building a scalable end-to-end product that can integrate front-end apps to provide a cart and payment services.

September 18, 2025

by Vaibhav Rastogi

· 2,311 Views · 1 Like

Creating a Distributed Computing Cluster for a Data Base Management System: Part 1

An introduction to DCC—a proxy-driven way to merge many DB servers into one virtual DBMS—and how it can scale read-heavy workloads with only modest transaction overhead.

September 18, 2025

by Vladimir Serdyuk

· 1,750 Views · 3 Likes

Development of System Configuration Management: Summary and Reflections

Custom-built SCM enhances infrastructure reproducibility and automation, but persistent challenges require continuous architectural improvements and smarter decisions.

September 18, 2025

by Georgii Kashintsev

· 2,045 Views · 1 Like

Learn how to set up AWS Budget notifications with SNS using AWS CDK in TypeScript, including gotchas around IAM and KMS policies.

September 17, 2025

by Jeroen Reijn

CORE

· 2,796 Views · 2 Likes

Building a Platform Abstraction for EKS Cluster Using Crossplane

Build Crossplane abstractions that let your devs request EKS clusters without writing infrastructure code. Create XRD and composition to hide details.

September 17, 2025

by Ramesh Sinha

· 4,067 Views · 2 Likes

Development of System Configuration Management: Performance Considerations

Integrated caching in Consul greatly improved SCM config delivery speed, using goroutines and checksums to reduce load, though deployment latency initially increased.

September 17, 2025

by Georgii Kashintsev

· 1,921 Views · 1 Like

Beyond Retrieval: How Knowledge Graphs Supercharge RAG

Graph RAG combines knowledge graphs with LLMs to structure text into entities and relationships, enabling explainable reasoning and more accurate insights.

September 17, 2025

by Salman Khan

CORE

· 3,625 Views · 2 Likes

The AI FOMO Paradox

The AI FOMO Paradox: Learn why knowledgeable Agile practitioners are perfectly positioned for the AI era, and the era of ‘good enough’ Agile is over.

September 17, 2025

by Stefan Wolpers

CORE

· 2,647 Views · 1 Like

How to Migrate from Java 8 to Java 17+ Using Amazon Q Developer

Learn how Amazon Q developer is speeding up application modernization and other benefits it offers to enterprises and developers

September 16, 2025

by Prabhakar Mishra

· 3,791 Views · 1 Like

Beyond Code: How to Use AI to Modernize Software Architecture

AI can accelerate development, but without guidance, it risks deepening architectural debt — with solid context and prompts, it can help strengthen architecture.

September 16, 2025

by John Vester

CORE

· 2,904 Views · 2 Likes

Multi-Agent (Multi-Function) Orchestration With AWS Step Functions

Learn about multi-agent (multi-function) orchestration with AWS step functions, which helps to orchestrate the different functionalities to work as a task.

September 16, 2025

by Prabhakar Mishra

· 2,927 Views

The Latest Data Engineering Topics