Data Engineering Resources

Agentic AI addresses API testing issues through test creation and maintenance, intelligent test coverage, and more. Here's how to prepare development workflows for AI.

November 17, 2025

by Zac Amos

· 3,061 Views · 3 Likes

Beyond Outages: Building True Resilience After the AWS Outage

True resilience means multi-cloud architecture, spreading critical workloads across AWS, Azure, or GCP with shared data, global load balancing, and unified monitoring.

November 17, 2025

by Jas Tandon

· 2,607 Views · 4 Likes

Integrating AWS With Okta for Just-in-Time (JIT) Access: A Practical Guide From the Field

Static IAM users, login roles were killing our security posture and slowing everyone down. So we wired Okta and AWS with SAML and Okta Workflows for JIT access.

November 17, 2025

by Sanjay Kurra

· 4,470 Views · 3 Likes

From Agent AI to Agentic AI: Building Self-Healing Kubernetes Clusters That Learn

Evolving from reactive Agent AI to autonomous Agentic AI: a self-healing Kubernetes system that learns from fixes and applies patterns automatically.

November 17, 2025

by Shamsher Khan

CORE

· 3,292 Views · 1 Like

Evaluating AI Vulnerability Detection: How Reliable Are LLMs for Secure Coding?

Can AI spot real-world security bugs? Semgrep’s research compares LLMs on their ability to catch SQLi, XSS, and IDOR vulnerabilities.

November 14, 2025

by Jayson DeLancey

· 4,461 Views · 4 Likes

Data Ingestion Using Logstash: PostgreSQL to Elasticsearch

Learn how to use Logstash to ingest, transform, and send data to Elasticsearch, including incremental pipelines, filters, and best practices.

November 14, 2025

by Mangesh Walimbe

· 8,122 Views · 2 Likes

Best Practices for Migrating Data From Legacy Systems With AI

In this article, I will share my experience with AI-powered data migration, including what worked well and key lessons learned along the way.

November 14, 2025

by Mykhailo Kopyl

· 3,155 Views · 4 Likes

Proactive vs Reactive: Rethinking Your AWS Monitoring Approach

Dynamic AWS environments require both reactive and proactive monitoring approaches for secure and reliable operations. Learn about their differences and best practices.

November 14, 2025

by Igboanugo David Ugochukwu

CORE

· 3,049 Views · 1 Like

Exploring MCP, A2A, and Functional Calling: The Modern Innovations for Enterprise LLM Architecture

MCP, A2A, and functional calling are crucial for next-generation AI ecosystems. Learn more about integrating these approaches in your organizational AI strategies.

November 14, 2025

by Damodhara Reddy Palavali

· 1,662 Views · 1 Like

Databricks vs Snowflake: Complete Architecture Mapping for Enterprise AI and Big Data

This guide maps core data, big data, and AI/ML concepts between Databricks and Snowflake, with examples, diagrams, and a framework for choosing or combining the two.

November 13, 2025

by Ram Ghadiyaram

CORE

· 7,181 Views · 7 Likes

Versioned Caching: A Practical Pattern for High-Performance Lookup Data

A practical guide to versioned caching for static lookup data using cache-control headers, local storage, and data version synchronization between client and server.

November 13, 2025

by Artsiom Lazouski

· 1,814 Views · 1 Like

AI SDLC Transformation, Part 1: Where to Start?

Learn how to successfully adopt AI in software delivery by measuring transformation, starting small, and creating AI-ready processes and teams.

November 13, 2025

by Orkhan Gasimov

· 3,741 Views · 3 Likes

DocumentDB Goes Cloud-Native: Introducing the DocumentDB Kubernetes Operator

Deploy, manage, and scale DocumentDB on Kubernetes with the new open-source DocumentDB Operator — cloud-native, PostgreSQL-based, and MongoDB-compatible.

November 13, 2025

by Abhishek Gupta

CORE

· 2,994 Views · 2 Likes

Facilitate AI-Human Architectural Thinking

Three pillars of the thinking framework: landscape view, decisional view, and structural view — an effective architectural modeling approach.

November 12, 2025

by Sean Gu

· 4,162 Views · 2 Likes

The Terraform State Locking Migration You Need to Know About: Moving Beyond DynamoDB

What's happening: HashiCorp is deprecating DynamoDB-based state locking for Terraform's S3 backend. Native S3 locking is the new standard.

November 12, 2025

by kazeem mohammed

· 3,804 Views · 2 Likes

Compose Architecture, Done Right: MVI’s Unidirectional State vs. MVVM

TL;DR: Compose wants one-way data and a single UiState. MVI delivers that-fewer surprises, cleaner tests, and explicit effects.

November 12, 2025

by Mohan Sankaran

· 1,986 Views · 6 Likes

How to Map PostgreSQL JSON Data Types in Java Using asentinel-orm

Convert between custom Java types and database types using the Spring framework's ConversionService, particularly for JSON entity attributes.

November 12, 2025

by Horatiu Dan

CORE

· 2,806 Views · 5 Likes

From Developer to AI Teammate: Building an Agentic Automation Prototype

Transform repetitive developer workflows into an intelligent, AI-powered teammate using LangChain, retrieval-augmented generation (RAG), and lightweight automation loops.

November 12, 2025

by Sayan Chatterjee

· 1,822 Views · 2 Likes

A Developer's Guide to Mastering Docker Networking Concepts

Learn the basics of creating Docker networks, the default network, and how to use Docker Compose to simplify the process of local development.

November 12, 2025

by Akaash Vishal Hazarika

· 3,168 Views · 5 Likes

GitLab CI/CD for Tenant-Specific ML Governance: Automating Model Registries in Databricks Unity Catalog on AWS

Automate multi-tenant ML governance in Databricks with GitLab CI/CD, ensuring secure, compliant model registration, validation, and deployment.

November 12, 2025

by Ankur Mahida

· 16,166 Views · 4 Likes

The Latest Data Engineering Topics