Data Engineering Resources

NVIDIA GPU Operator Explained: Simplifying GPU Workloads on Kubernetes

Learn how NVIDIA GPU Operator simplifies GPU management in Kubernetes. Explore features, setup steps, and best practices for AI/ML workloads.

November 18, 2025

by Sagar Parmar

· 3,231 Views · 1 Like

Building a Containerized Quarkus API on AWS ECS/Fargate With CDK

Build production-ready Quarkus API on AWS ECS with CDK Infrastructure as Code. Includes database integration, caching, and comprehensive testing.

November 18, 2025

by Nicolas Duminil

CORE

· 4,809 Views

Aggregation Strategies for Scalable Data Insights: A Technical Perspective

This blog compares Elasticsearch aggregations: Sampler (fast), Composite (efficient), and Terms (for categories). Choose based on your data and performance needs.

November 18, 2025

by Navedha Sadhan

· 1,023 Views

Beyond the Vibe: Why AI Coding Workflows Need a Framework

"Vibe coding" with AI improvising without a plan is fast but costly, leading to high rework, wasted money on tokens, and low-quality code.

November 17, 2025

by Akash Lomas

· 6,068 Views · 2 Likes

Private AI at Home: A RAG-Powered Secure Chatbot for Everyday Help

Secure RAG chatbot built with Spring AI with local embeddings and PostgreSQL. Hosted on Linux PCs, it ensures privacy, context‑aware answers, reproducible deployments.

November 17, 2025

by Soham Sengupta

· 3,131 Views · 1 Like

From Data Lakes to Intelligence Lakes: Augmenting Apache Iceberg With Generative AI Metadata on AWS

Build an AI-augmented data lake using Iceberg, Glue, and Bedrock to turn static metadata into searchable intelligence with semantic tags and AI summaries.

November 17, 2025

by Vivek Venkatesan

· 5,448 Views · 1 Like

How Agentic AI Enhances API Testing

Agentic AI addresses API testing issues through test creation and maintenance, intelligent test coverage, and more. Here's how to prepare development workflows for AI.

November 17, 2025

by Zac Amos

· 2,972 Views · 3 Likes

Beyond Outages: Building True Resilience After the AWS Outage

True resilience means multi-cloud architecture, spreading critical workloads across AWS, Azure, or GCP with shared data, global load balancing, and unified monitoring.

November 17, 2025

by Jas Tandon

· 2,546 Views · 4 Likes

Integrating AWS With Okta for Just-in-Time (JIT) Access: A Practical Guide From the Field

Static IAM users, login roles were killing our security posture and slowing everyone down. So we wired Okta and AWS with SAML and Okta Workflows for JIT access.

November 17, 2025

by Sanjay Kurra

· 4,355 Views · 3 Likes

From Agent AI to Agentic AI: Building Self-Healing Kubernetes Clusters That Learn

Evolving from reactive Agent AI to autonomous Agentic AI: a self-healing Kubernetes system that learns from fixes and applies patterns automatically.

November 17, 2025

by Shamsher Khan

CORE

· 3,179 Views · 1 Like

Evaluating AI Vulnerability Detection: How Reliable Are LLMs for Secure Coding?

Can AI spot real-world security bugs? Semgrep’s research compares LLMs on their ability to catch SQLi, XSS, and IDOR vulnerabilities.

November 14, 2025

by Jayson DeLancey

· 4,377 Views · 4 Likes

Data Ingestion Using Logstash: PostgreSQL to Elasticsearch

Learn how to use Logstash to ingest, transform, and send data to Elasticsearch, including incremental pipelines, filters, and best practices.

November 14, 2025

by Mangesh Walimbe

· 7,976 Views · 2 Likes

Best Practices for Migrating Data From Legacy Systems With AI

In this article, I will share my experience with AI-powered data migration, including what worked well and key lessons learned along the way.

November 14, 2025

by Mykhailo Kopyl

· 3,086 Views · 4 Likes

Proactive vs Reactive: Rethinking Your AWS Monitoring Approach

Dynamic AWS environments require both reactive and proactive monitoring approaches for secure and reliable operations. Learn about their differences and best practices.

November 14, 2025

by Igboanugo David Ugochukwu

CORE

· 2,977 Views · 1 Like

Exploring MCP, A2A, and Functional Calling: The Modern Innovations for Enterprise LLM Architecture

MCP, A2A, and functional calling are crucial for next-generation AI ecosystems. Learn more about integrating these approaches in your organizational AI strategies.

November 14, 2025

by Damodhara Reddy Palavali

· 1,641 Views · 1 Like

Databricks vs Snowflake: Complete Architecture Mapping for Enterprise AI and Big Data

This guide maps core data, big data, and AI/ML concepts between Databricks and Snowflake, with examples, diagrams, and a framework for choosing or combining the two.

November 13, 2025

by Ram Ghadiyaram

CORE

· 7,017 Views · 7 Likes

Versioned Caching: A Practical Pattern for High-Performance Lookup Data

A practical guide to versioned caching for static lookup data using cache-control headers, local storage, and data version synchronization between client and server.

November 13, 2025

by Artsiom Lazouski

· 1,770 Views · 1 Like

AI SDLC Transformation, Part 1: Where to Start?

Learn how to successfully adopt AI in software delivery by measuring transformation, starting small, and creating AI-ready processes and teams.

November 13, 2025

by Orkhan Gasimov

· 3,592 Views · 3 Likes

DocumentDB Goes Cloud-Native: Introducing the DocumentDB Kubernetes Operator

Deploy, manage, and scale DocumentDB on Kubernetes with the new open-source DocumentDB Operator — cloud-native, PostgreSQL-based, and MongoDB-compatible.

November 13, 2025

by Abhishek Gupta

CORE

· 2,956 Views · 2 Likes

Facilitate AI-Human Architectural Thinking

Three pillars of the thinking framework: landscape view, decisional view, and structural view — an effective architectural modeling approach.

November 12, 2025

by Sean Gu

· 4,002 Views · 2 Likes

The Latest Data Engineering Topics