Data Engineering Resources

The Terraform State Locking Migration You Need to Know About: Moving Beyond DynamoDB

What's happening: HashiCorp is deprecating DynamoDB-based state locking for Terraform's S3 backend. Native S3 locking is the new standard.

November 12, 2025

by kazeem mohammed

· 3,689 Views · 2 Likes

Compose Architecture, Done Right: MVI’s Unidirectional State vs. MVVM

TL;DR: Compose wants one-way data and a single UiState. MVI delivers that-fewer surprises, cleaner tests, and explicit effects.

November 12, 2025

by Mohan Sankaran

· 1,856 Views · 6 Likes

How to Map PostgreSQL JSON Data Types in Java Using asentinel-orm

Convert between custom Java types and database types using the Spring framework's ConversionService, particularly for JSON entity attributes.

November 12, 2025

by Horatiu Dan

CORE

· 2,764 Views · 5 Likes

From Developer to AI Teammate: Building an Agentic Automation Prototype

Transform repetitive developer workflows into an intelligent, AI-powered teammate using LangChain, retrieval-augmented generation (RAG), and lightweight automation loops.

November 12, 2025

by Sayan Chatterjee

· 1,787 Views · 2 Likes

A Developer's Guide to Mastering Docker Networking Concepts

Learn the basics of creating Docker networks, the default network, and how to use Docker Compose to simplify the process of local development.

November 12, 2025

by Akaash Vishal Hazarika

· 3,114 Views · 5 Likes

GitLab CI/CD for Tenant-Specific ML Governance: Automating Model Registries in Databricks Unity Catalog on AWS

Automate multi-tenant ML governance in Databricks with GitLab CI/CD, ensuring secure, compliant model registration, validation, and deployment.

November 12, 2025

by Ankur Mahida

· 16,082 Views · 4 Likes

AI Code Refactoring: Principles, Techniques, and Benefits

Refactoring enhances code quality, performance, and maintainability using AI to automate improvements. Key principles are readability, modularity, and efficiency.

November 12, 2025

by Mitchell Jhonson

· 1,868 Views · 2 Likes

The DSPM Paradox: Perceived Controls for an Uncontrollable Data Landscape

You can't stop every burglar, but you can ensure your valuables are in a safe they can't crack. Why DSPM tools create an illusion of control in modern data security.

November 12, 2025

by Hamid Akhtar

· 1,228 Views

A Growing Security Concern: Prompt Injection Vulnerabilities in Model Context Protocol Systems

Prompt injection can make AI assistants a privilege‑escalation risk. Learn attack patterns and layered defenses: isolation, sanitization, validation.

November 11, 2025

by Janani Annur Thiruvengadam

CORE

· 2,131 Views · 4 Likes

Gatherers in Java: What They Are and Why They Matter

With Stream API, developers could only customize terminal operations using Collector. Stream Gatherers allow developers to define custom intermediate operations.

November 11, 2025

by Ammar Husain

CORE

· 4,980 Views · 8 Likes

Creating an MCP Server With Spring AI

This article provides a step-by-step guide to creating a Model Context Protocol (MCP) server using Spring AI and explains the advantages of using MCP.

November 11, 2025

by Gunter Rotsaert

CORE

· 5,004 Views · 6 Likes

Decentralized Identity Management: The Future of Privacy and Security

As more of our information goes digital and cybersecurity awareness increases, DIM feels like the natural next step of identity management.

November 11, 2025

by Ben Hartwig

· 2,556 Views · 2 Likes

Docker Security: 6 Practical Labs From Audit to AI Protection

Master Docker security with six practical labs that take you from basic configuration audits to advanced AI workload protection

November 10, 2025

by Shamsher Khan

CORE

· 4,712 Views · 6 Likes

How Tool-Call Observability Enables You to Support Reliable and Secure AI Agents

Observability is key for performance and data security. Here's how to build the essential components into your AI agent infrastructure

November 10, 2025

by Gil Feig

· 2,100 Views · 2 Likes

Event-Driven Architecture Patterns: Real-World Lessons From IoT Development

Real-world lessons on building event-driven systems for IoT and microservices — and model optimization with practical code examples.

November 10, 2025

by Bhavna Hirani

· 7,708 Views · 6 Likes

GitOps-Backed Agentic Operator for Kubernetes: Safe Auto-Remediation With LLMs and Policy Guardrails

Create an AI-driven Kubernetes Operator that analyzes failures, generates fixes with LLMs, validates them with OPA, and applies changes safely via GitOps.

November 10, 2025

by Sajal Nigam

· 4,778 Views · 4 Likes

Hudi vs. Delta vs. Iceberg: How to Choose the Right Lakehouse Table Format

Hudi excels at real-time upserts, Delta handles ACID workloads, and Iceberg supports large-scale analytics with flexible schemas.

November 10, 2025

by harshraj bhoite

· 3,491 Views · 1 Like

Regression Analysis for Time Series Data: Models and Applications

Ready to use regression analysis for time series data? Explore how this method works in practice to effectively predict future outcomes and drive growth.

November 10, 2025

by Oleksandr Stefanovskyi

· 1,507 Views · 1 Like

AI-Driven Generative Design: Automating Architectural Layouts

AI-driven generative design automates architectural layouts using optimization and machine learning, enabling faster, smarter, and data-driven design solutions.

November 10, 2025

by Gurcharan Singh

· 1,840 Views

Beyond Dashboards: How Autonomous AI Agents Are Redefining Enterprise Analytics

Agentic AI is fundamentally changing how organizations extract insights from data and make strategic decisions, moving from reactive reporting to autonomous intelligence.

November 7, 2025

by Mohan Krishna Mannava

· 2,046 Views · 2 Likes

The Latest Data Engineering Topics