Data Engineering Resources

Learn how LLMs can analyze code, assist in debugging workflows, and where their current limitations open space for future innovation.

September 18, 2025

by Surya Teja Appini

· 4,383 Views · 3 Likes

Blueprint for Agentic AI: Azure AI Foundry, AutoGen, and Beyond

Azure AI Foundry and AutoGen enable scalable, collaborative AI agents that automate complex tasks with minimal human effort.

September 18, 2025

by Anand Singh

· 3,881 Views · 1 Like

FOSDEM 2025 Recap: Open Source Contributors Unite to Collaborate and Help Advance Apache Software Projects

Apache Software Foundation participants shared observations from FOSDEM 25 to showcase some of the work that community members do for open-source software development.

September 18, 2025

by Brian Proffitt

· 1,507 Views

Unified Checkout Experience Through Micro Frontend Architecture

Learn about the architecture and design for building a scalable end-to-end product that can integrate front-end apps to provide a cart and payment services.

September 18, 2025

by Vaibhav Rastogi

· 2,180 Views · 1 Like

Creating a Distributed Computing Cluster for a Data Base Management System: Part 1

An introduction to DCC—a proxy-driven way to merge many DB servers into one virtual DBMS—and how it can scale read-heavy workloads with only modest transaction overhead.

September 18, 2025

by Vladimir Serdyuk

· 1,689 Views · 3 Likes

Development of System Configuration Management: Summary and Reflections

Custom-built SCM enhances infrastructure reproducibility and automation, but persistent challenges require continuous architectural improvements and smarter decisions.

September 18, 2025

by Georgii Kashintsev

· 1,929 Views · 1 Like

Learn how to set up AWS Budget notifications with SNS using AWS CDK in TypeScript, including gotchas around IAM and KMS policies.

September 17, 2025

by Jeroen Reijn

CORE

· 2,712 Views · 2 Likes

Building a Platform Abstraction for EKS Cluster Using Crossplane

Build Crossplane abstractions that let your devs request EKS clusters without writing infrastructure code. Create XRD and composition to hide details.

September 17, 2025

by Ramesh Sinha

· 3,820 Views · 2 Likes

Development of System Configuration Management: Performance Considerations

Integrated caching in Consul greatly improved SCM config delivery speed, using goroutines and checksums to reduce load, though deployment latency initially increased.

September 17, 2025

by Georgii Kashintsev

· 1,807 Views · 1 Like

Beyond Retrieval: How Knowledge Graphs Supercharge RAG

Graph RAG combines knowledge graphs with LLMs to structure text into entities and relationships, enabling explainable reasoning and more accurate insights.

September 17, 2025

by Salman Khan

CORE

· 3,505 Views · 2 Likes

The AI FOMO Paradox

The AI FOMO Paradox: Learn why knowledgeable Agile practitioners are perfectly positioned for the AI era, and the era of ‘good enough’ Agile is over.

September 17, 2025

by Stefan Wolpers

CORE

· 2,566 Views · 1 Like

How to Migrate from Java 8 to Java 17+ Using Amazon Q Developer

Learn how Amazon Q developer is speeding up application modernization and other benefits it offers to enterprises and developers

September 16, 2025

by Prabhakar Mishra

· 3,637 Views · 1 Like

Beyond Code: How to Use AI to Modernize Software Architecture

AI can accelerate development, but without guidance, it risks deepening architectural debt — with solid context and prompts, it can help strengthen architecture.

September 16, 2025

by John Vester

CORE

· 2,576 Views · 2 Likes

Multi-Agent (Multi-Function) Orchestration With AWS Step Functions

Learn about multi-agent (multi-function) orchestration with AWS step functions, which helps to orchestrate the different functionalities to work as a task.

September 16, 2025

by Prabhakar Mishra

· 2,762 Views

Automating RCA and Decision Support Using AI Agents

The article explores how AI agents can automate insight generation, assist teams in root cause analysis, and outline a scalable agentic AI architecture for enterprises.

September 16, 2025

by Ishita Choudhary

· 3,072 Views · 2 Likes

How TBMQ Uses Redis for Persistent Message Storage

Learn how we use Redis to scale MQTT session persistence in TBMQ — replacing PostgreSQL and improving performance with Lua scripts and the Lettuce async client.

September 16, 2025

by Dmytro Shvaika

· 5,434 Views · 19 Likes

Geometric Deep Learning: AI Beyond Text and Images

In this article, you will learn about how geometric deep learning extends AI to analyze complex non-Euclidean data like molecules, 3D models, and networks.

September 16, 2025

by Kevin Vu

· 1,159 Views · 1 Like

From Laptop to Cloud: Building and Scaling AI Agents With Docker Compose and Offload

AI agents need more than one service. Docker Compose keeps them simple to run, and Docker Offload shifts workloads to cloud GPUs.

September 15, 2025

by Pragya Keshap

· 6,828 Views · 4 Likes

Spring Cloud Gateway With Service Discovery Using HashiCorp Consul

This article introduces HashiCorp Consul, a service registry and discovery tool that integrates well with Spring Boot and supports reactive programming.

September 15, 2025

by Vishnu Viswambharan

· 4,631 Views · 4 Likes

Mastering Approximate Top K: Choosing Optimal Count-Min Sketch Parameters

A practical guide to configuring width (w) and depth (d) in Count-Min Sketch for efficient top-k estimation and real-time analytics.

September 15, 2025

by Baskar Sikkayan

· 2,635 Views · 3 Likes

The Latest Data Engineering Topics