Data Engineering Resources

Advanced Snowflake SQL for Data Engineering Analytics

Learn seven advanced Snowflake SQL queries for online retail analytics, with visualizations and tips for scalable data pipelines.

October 14, 2025

by Ram Ghadiyaram

CORE

· 2,412 Views · 1 Like

CNCF Triggers a Platform Parity Breakthrough for Arm64 and x86

Actuated plus Ampere-powered runners let CNCF maintainers test and ship Arm64 natively, closing the gap with x86 across CI/CD.

October 14, 2025

by Scott Fulton III

· 2,279 Views · 2 Likes

Inside Microsoft Fabric: How Data Agents, Copilot Studio, and Real-Time Intelligence Power the AI-Driven Enterprise

Learn how developers can use data agents for natural-language querying, Copilot Studio for AI interactions, and real-time intelligence for streaming analytics.

October 14, 2025

by Vishwa Kishore Mannem

· 3,097 Views · 2 Likes

Making AI Better: A Deep Dive Across Users, Developers, and Businesses

In this sequel to Making AI Faster, I explore why making AI better matters and share strategies across user, developer, and business perspectives.

October 14, 2025

by Gunveer Gujral

· 1,319 Views · 1 Like

A Fresh Look at Optimizing Apache Spark Programs

Optimize Spark jobs by tuning configurations, writing efficient code (Data Frames, broadcast joins), using optimized storage, and monitoring the Spark UI and logs.

October 14, 2025

by Nataraj Mocherla

· 3,046 Views · 2 Likes

How Developers Use Synthetic Data to Stress-Test Models in Noisy Markets

Synthetic data lets quants stress-test equity strategies beyond noisy markets, preserving volatility, and building resilience before risking real capital.

October 14, 2025

by Jay Mehta

· 1,325 Views · 1 Like

Operationalizing Responsible AI: Turning Ethics Into Engineering

This article will provide a direction on how to build a reliable AI system in production by incorporating bias mitigation strategies.

October 13, 2025

by Jofia Jose Prakash

· 2,210 Views · 2 Likes

Apache Iceberg REST Catalog: The Key to Vendor-Agnostic Data Interoperability

In this article, I have demonstrated how Iceberg Data can be accessed through the Iceberg REST Catalog from Data Mesh with a simple Python application.

October 13, 2025

by Pravin Dwiwedi

· 2,614 Views · 1 Like

What Is API Testing?

API testing explained: Learn what an API is, its different testing types, tools, and benefits to improve software quality and reliability.

October 13, 2025

by Faisal Khatri

CORE

· 2,089 Views · 4 Likes

AI Infrastructure: Compute, Storage, Observability, Security, and More

In this final article, you will learn about AI infrastructure compute, storage, observability, optimization, security, and deployment architecture.

October 13, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 2,417 Views · 4 Likes

AI-Driven Developer Tools: Transforming the Future of Software Development

AI-driven developer tools boost speed, quality, and security in software development by automating coding, testing, and debugging.

October 13, 2025

by Ilya Dudkin

CORE

· 1,707 Views · 1 Like

Beyond Traditional Load Balancers: The Role of Inference Routers in AI Systems

Inference routing is the process of routing AI inference requests to the most suitable model based on cost, latency, quality, etc.

October 13, 2025

by Bhala Ranganathan

CORE

· 2,016 Views · 1 Like

Why Enterprise AI Needs Agentic Messaging Platforms

AI projects stall on plumbing, not progress. Agentic messaging platforms unify APIs, tools, and observability so teams can focus on AI logic.

October 13, 2025

by John Vester

CORE

· 1,320 Views

Infusing AI into Your Java Applications

An introductory tutorial for Java developers on writing AI-infused applications using Quarkus with LangChain4j. You don't need Python to write AI apps.

October 10, 2025

by Don Bourne

· 6,190 Views · 10 Likes

Long-Running Durable Agents With Spring AI and Dapr Workflows

Spring AI agentic patterns show how to coordinate multiple ChatClient calls to LLMs. We look at how Dapr Workflows can make these interactions durable and resilient.

October 10, 2025

by Mauricio Salatino

· 4,264 Views

Introduction to Spring Data Elasticsearch 5.5

Getting started with the latest version of Spring Data Elasticsearch 5.5 and Elasticsearch 8.18 as a NoSQL database for our data storage.

October 10, 2025

by Arnošt Havelka

CORE

· 3,049 Views · 2 Likes

Fixing a Test Involves Much More Than Simply Making It Pass

Learn why using Postman's 'Fix test' may mask bugs — tips to investigate failures, preserve test intent, and protect API reliability. Verify, then act.

October 10, 2025

by Stelios Manioudakis

CORE

· 4,778 Views · 3 Likes

AI-Assisted Kubernetes Diagnostics: A Practical Implementation

Proof-of-concept tool using GPT-4 to detect failing Kubernetes pods, analyze logs and events, and suggest fixes with human approval for common issues.

October 10, 2025

by Shamsher Khan

CORE

· 4,271 Views · 5 Likes

Building Realistic Test Data in Java: A Hands-On Guide for Developers

Learn how to build a simple API that delivers believable fake users, perfect for testing, demos, or UI prototyping. No more “John Doe” data, finally, real-feel mocks.

October 10, 2025

by Wallace Espindola

· 3,381 Views · 8 Likes

Using LLMs to Automate Root Cause Analysis in Incident Response

LLMs streamline incident response by quickly identifying root causes from logs and alerts, cutting down manual effort and downtime.

October 9, 2025

by Venkatesan Thirumalai

· 4,481 Views · 3 Likes

The Latest Data Engineering Topics