Data Engineering Resources

Agentic AI Using Apache Kafka as Event Broker With the Agent2Agent Protocol (A2A) and MCP

Agentic AI becomes scalable and production-ready when powered by Apache Kafka with MCP and A2A for real-time, decoupled agent communication.

November 4, 2025

by Kai Wähner

CORE

· 2,363 Views · 7 Likes

Top Takeaways From Devoxx Belgium 2025

In October 2025, Devoxx Belgium showcased its 22nd edition, emphasizing Java and AI advancements. Sessions covered were AI workflows, architecture decisions, and more.

November 4, 2025

by Gunter Rotsaert

CORE

· 1,688 Views · 3 Likes

AIOps to Agentic AIOps: Building Trustworthy Symbiotic Workflows With Human-in-the-Loop LLMs

Build secure, human-in-the-loop AIOps workflows using agentic AI for smart alert triage, context summarization, and automated, safe incident resolution.

November 4, 2025

by Pratik Prakash

CORE

· 3,430 Views

Building a Resilient Observability Stack in 2025: Practical Steps to Reduce Tool Sprawl With OpenTelemetry, Unified Platforms, and AI-Ready Monitoring

Learn how to cut observability tool sprawl, adopt OpenTelemetry, and build a vendor-neutral, AI-ready observability stack for reliability at scale in 2025.

November 3, 2025

by Marija Naumovska

CORE

· 3,082 Views · 1 Like

5 Critical Databricks Performance Hacks That Most Engineers Miss (100x Faster Queries)

In this article, learn to boost Databricks' performance with six proven optimization strategies for UDFs, AQE, Delta Lake, broadcasts, and Photon acceleration.

November 3, 2025

by Ram Ghadiyaram

CORE

· 3,503 Views · 4 Likes

What Is Agent Observability? Key Lessons Learned

A foundational guide to the key concepts of agent observability including best practices, metrics, and common challenges.

November 3, 2025

by Lior Gavish

· 2,601 Views · 3 Likes

Understanding Bigfile Tablespace Defaults in Oracle Database 23ai: Impact and Benefits

Oracle Database 23ai makes bigfile tablespaces the default, simplifying storage management and boosting scalability for modern, cloud-ready databases.

November 3, 2025

by arvind toorpu

CORE

· 2,962 Views · 2 Likes

Navigating the Cyber Frontier: AI and ML's Role in Shaping Tomorrow's Threat Defense

AI and ML are transforming cybersecurity with adaptive defenses, predictive analysis, and automation, shaping a smarter, more resilient digital future.

November 3, 2025

by Geethamanikanta Jakka

· 1,379 Views · 2 Likes

Delta Lake 4.0 and Delta Kernel: What's New in the Future of Data Lakehouses

Delta Lake 4.0 pushes the lakehouse forward with flexible schemas, stronger transactions, remote, multi‑engine access, self‑optimizing performance, and AI‑ready storage.

November 3, 2025

by Sairamakrishna BuchiReddy Karri

· 3,620 Views · 2 Likes

Human-AI Readiness

AI is reshaping work through human-AI collaboration. Learn how organizations can build readiness, maturity, and thrive in the hybrid intelligence era.

November 3, 2025

by Rick Freedman

· 1,797 Views · 2 Likes

Series (3/4): Toward a Shared Language Between Humans and Machines — Quantum Language and the Limits of Simulation

Can quantum computing encode meaning into qubits? This part analyzes how quantum language processing might offer a radically new path.

October 31, 2025

by Frederic Jacquet

CORE

· 1,917 Views · 1 Like

Streamlining Real-Time Ad Tech Systems: Techniques to Prevent Performance Bottlenecks

Ad tech platforms depend on microscopic efficiency. Profiling and disciplined logging collectively cut waste and latency, turning scale into sustainable profit.

October 31, 2025

by Jeet Nishit Mehta

· 2,016 Views · 1 Like

How Modern Developers Use AI-Assisted Coding to Validate Products Faster

Learn how developers use AI-assisted coding to validate products 55% faster through automated testing, rapid prototyping, and streamlined code reviews.

October 31, 2025

by Henry Ameseder

· 2,238 Views · 3 Likes

An Open-Source ChatGPT App Generator

Create fully functional ChatGPT apps using AI — no coding needed. Build and deploy interactive UI widgets directly inside ChatGPT in just minutes.

October 31, 2025

by Thomas Hansen

CORE

· 2,056 Views · 4 Likes

When Coalesce Is Slower Than Repartition: A Spark Performance Paradox

In this article, learn why repartition() can outperform coalesce() in Apache Spark — and how Catalyst optimizer pushdown can throttle your job’s parallelism.

October 30, 2025

by Janani Annur Thiruvengadam

CORE

· 2,879 Views · 3 Likes

SQL Ledger in SQL Server 2022: Tamper-Evident Audit Trails and Immutable Ledger Tables

SQL Ledger in SQL Server 2022 ensures tamper-evident data integrity with blockchain-based ledger tables. Append-only tables provide immutable audit trails for compliance.

October 30, 2025

by arvind toorpu

CORE

· 4,501 Views · 1 Like

Keyword vs Semantic Search With AI

Learn in this article how to build keyword-based and semantic search in MariaDB using Python, LangChain, FastAPI, and AI embeddings.

October 30, 2025

by Alejandro Duarte

CORE

· 1,994 Views · 4 Likes

Improving Developer Productivity With End-to-End GenAI Enablement

Build an end-to-end developer enablement hub locally with GenAI, automating everything from requirements to deployment to boost productivity and streamline workflows.

October 30, 2025

by Nabin Debnath

· 2,625 Views · 2 Likes

How to Get a Frequency Table of a Categorical Variable as a Data Frame

Learn how to get a frequency table of a categorical variable as a Data Frame in R using table(), cut(), count(), and plyr — with clean, ready-to-use output.

October 30, 2025

by Chaitanya Sagar

· 1,513 Views · 1 Like

Building a New Testing Mindset for AI-Powered Web Apps

Learn about AI-powered testing strategies to ensure your intelligent systems are reliable, ethical, and aligned with business goals.

October 30, 2025

by Kailash Pathak

CORE

· 2,267 Views · 2 Likes

The Latest Data Engineering Topics