Data Engineering Resources

Learn how to set up AWS Budget notifications with SNS using AWS CDK in TypeScript, including gotchas around IAM and KMS policies.

September 17, 2025

by Jeroen Reijn

CORE

· 2,755 Views · 2 Likes

Building a Platform Abstraction for EKS Cluster Using Crossplane

Build Crossplane abstractions that let your devs request EKS clusters without writing infrastructure code. Create XRD and composition to hide details.

September 17, 2025

by Ramesh Sinha

· 3,865 Views · 2 Likes

Development of System Configuration Management: Performance Considerations

Integrated caching in Consul greatly improved SCM config delivery speed, using goroutines and checksums to reduce load, though deployment latency initially increased.

September 17, 2025

by Georgii Kashintsev

· 1,855 Views · 1 Like

Beyond Retrieval: How Knowledge Graphs Supercharge RAG

Graph RAG combines knowledge graphs with LLMs to structure text into entities and relationships, enabling explainable reasoning and more accurate insights.

September 17, 2025

by Salman Khan

CORE

· 3,560 Views · 2 Likes

The AI FOMO Paradox

The AI FOMO Paradox: Learn why knowledgeable Agile practitioners are perfectly positioned for the AI era, and the era of ‘good enough’ Agile is over.

September 17, 2025

by Stefan Wolpers

CORE

· 2,609 Views · 1 Like

How to Migrate from Java 8 to Java 17+ Using Amazon Q Developer

Learn how Amazon Q developer is speeding up application modernization and other benefits it offers to enterprises and developers

September 16, 2025

by Prabhakar Mishra

· 3,704 Views · 1 Like

Beyond Code: How to Use AI to Modernize Software Architecture

AI can accelerate development, but without guidance, it risks deepening architectural debt — with solid context and prompts, it can help strengthen architecture.

September 16, 2025

by John Vester

CORE

· 2,673 Views · 2 Likes

Multi-Agent (Multi-Function) Orchestration With AWS Step Functions

Learn about multi-agent (multi-function) orchestration with AWS step functions, which helps to orchestrate the different functionalities to work as a task.

September 16, 2025

by Prabhakar Mishra

· 2,813 Views

Automating RCA and Decision Support Using AI Agents

The article explores how AI agents can automate insight generation, assist teams in root cause analysis, and outline a scalable agentic AI architecture for enterprises.

September 16, 2025

by Ishita Choudhary

· 3,121 Views · 2 Likes

How TBMQ Uses Redis for Persistent Message Storage

Learn how we use Redis to scale MQTT session persistence in TBMQ — replacing PostgreSQL and improving performance with Lua scripts and the Lettuce async client.

September 16, 2025

by Dmytro Shvaika

· 5,565 Views · 19 Likes

Geometric Deep Learning: AI Beyond Text and Images

In this article, you will learn about how geometric deep learning extends AI to analyze complex non-Euclidean data like molecules, 3D models, and networks.

September 16, 2025

by Kevin Vu

· 1,193 Views · 1 Like

From Laptop to Cloud: Building and Scaling AI Agents With Docker Compose and Offload

AI agents need more than one service. Docker Compose keeps them simple to run, and Docker Offload shifts workloads to cloud GPUs.

September 15, 2025

by Pragya Keshap

· 6,943 Views · 4 Likes

Spring Cloud Gateway With Service Discovery Using HashiCorp Consul

This article introduces HashiCorp Consul, a service registry and discovery tool that integrates well with Spring Boot and supports reactive programming.

September 15, 2025

by Vishnu Viswambharan

· 4,718 Views · 4 Likes

Mastering Approximate Top K: Choosing Optimal Count-Min Sketch Parameters

A practical guide to configuring width (w) and depth (d) in Count-Min Sketch for efficient top-k estimation and real-time analytics.

September 15, 2025

by Baskar Sikkayan

· 2,748 Views · 3 Likes

How AI and Machine Learning Are Shaping the Fight Against Ransomware

This article examines how artificial intelligence and machine learning are revolutionizing the fight against ransomware.

September 15, 2025

by Daniel Akomolafe

· 1,737 Views · 3 Likes

Toward Explainable AI (Part 10): Bridging Theory and Practice—Responsible AI: Ambition or Illusion?

Explainable AI bridges the gap between complex models and real-world accountability, helping teams build trust, ensure compliance, and make smarter decisions.

September 15, 2025

by Frederic Jacquet

CORE

· 1,408 Views · 3 Likes

GenAI Beyond Just LLMs

GenAI is not just LLMs and agents. Learn about the power of Chemistry Foundation Models, and how they can accelerate molecular and materials discovery.

September 15, 2025

by Nimit Patel

· 1,310 Views · 3 Likes

Benchmarking Open-Source LLMs: LLaMA vs Mistral vs Gemma — A Practical Guide for Developers Building Private Models

Open-source LLMs like LLaMA, Mistral, and Gemma are reshaping private AI. Learn their performance, architecture, and deployment to choose the right model.

September 15, 2025

by harshraj bhoite

· 6,894 Views · 1 Like

Agentic AI: The Next Evolution of Artificial Intelligence and Autonomous Automation

AI has progressed from assistants like Siri and Alexa to ChatGPT requiring human input, and now to Agentic AI, which autonomously thinks, plans, and executes tasks.

September 15, 2025

by Shubham Gupta

· 2,061 Views · 2 Likes

Enhancing AI Privacy: Federated Learning and Differential Privacy in Machine Learning

The article explores Federated Learning and Differential Privacy as key techniques for privacy-preserving machine learning.

September 12, 2025

by Shaurya Jain

· 3,142 Views · 2 Likes

The Latest Data Engineering Topics