Data Engineering Resources

5 Ways Microsoft’s MCP Protocol Will Transform Software Testing Forever

Microsoft's MCP Protocol uses AI to automate and transform software testing, generating tests, fixing errors, and monitoring in real time. Adapt or fall behind.

July 28, 2025

by Nidhi Sharma

· 2,359 Views · 6 Likes

How to Ethically Integrate AI Into Your Software

AI is growing at a staggering rate. With this evolution, ethical concerns have come up around how this can impact software development. Here's how to handle it.

July 28, 2025

by Syed Balkhi

· 1,267 Views

Unity Catalog + AI: How Databricks Is Making Data Governance AI-Native in 2025

Data governance from a restrictive practice to an enabling force, facilitating intelligent, secure, and agile data management within enterprises.

July 25, 2025

by Sairamakrishna BuchiReddy Karri

· 3,461 Views · 1 Like

AI for Agile Coaches: The Upgrade You Didn't Know You Needed

Discover how AI lightens the load for Agile coaches, automating sprint prep and preserving psychological safety, with human leadership still at the core.

July 25, 2025

by Ella Mitkin

· 2,278 Views · 3 Likes

Configuring Embedded Global Cache for App Connect Enterprise Running in Containers

Step-by-step instructions and important considerations to help you get the new Embedded Global Cache feature in ACE up and running in your containerized platform.

July 25, 2025

by Amar Shah

· 2,952 Views

CI/CD at Scale: Smarter Pipelines for Monorepo Mayhem

Smarter CI/CD for monorepos: use affected-only builds, caching, AI, and modular pipelines to scale efficiently without sacrificing velocity.

July 25, 2025

by Mohit Menghnani

CORE

· 3,144 Views · 3 Likes

Smart-Doc: Generating gRPC API Documentation in Java Projects

In Java microservices, gRPC simplifies communication, but API documentation is challenging. Smart-doc efficiently handles gRPC API documentation.

July 25, 2025

by sun yu

· 3,235 Views

Test Pyramid: Test Setup Best Practices

Here, I revisit the plain old test pyramid and will speak a lot about how one can structure the tests to make them more reliable and profitable.

July 25, 2025

by Bartłomiej Żyliński

CORE

· 1,455 Views · 2 Likes

Modern Data Projects Need Agile Thinking — Not Just Tech

Agile isn’t just for software. This article demonstrates how Agile methods enable data teams to adapt quickly, deliver tangible value, and avoid common project pitfalls.

July 25, 2025

by Pabitra Saikia

CORE

· 1,715 Views · 2 Likes

Data Partitioning and Bucketing: How Modern Data Systems Organize and Optimize Your Data

This article explains how partitioning and bucketing work in the big data world and talks about best practices that you can follow.

July 24, 2025

by Rajanikantarao Vellaturi

· 4,029 Views · 6 Likes

How LangChain Is Powering Next-Gen AI Apps: A Developer’s Guide in 2025

LangChain is a pivotal framework empowering developers to efficiently integrate advanced language models into AI applications.

July 24, 2025

by Sairamakrishna BuchiReddy Karri

· 3,234 Views · 1 Like

Absolute Zero: How AI Is Learning Without Data

The Absolute Zero Reasoner diverges from traditional AI learning approaches by enabling AI to learn from scratch, without the need for pre-existing human-provided data.

July 24, 2025

by Tony Siciliani

· 2,175 Views

Concurrency in Rust: Writing Safe and Efficient Code

Rust's unique ownership model and expressive type system provide safe, efficient concurrency without data races or memory safety concerns.

July 24, 2025

by Sairamakrishna BuchiReddy Karri

· 2,519 Views · 1 Like

[Part-4] Text to Action: Wake Word Detection Speech to Calendar Event

Build a hands-free voice assistant with wake word detection that converts "Hey Calendar" commands into Google Calendar events using Web Speech API and AI.

July 24, 2025

by Vivek Vellaiyappan Surulimuthu

· 1,916 Views · 2 Likes

Deploying Containers on Azure Container Apps

In this article, we’ll explore Azure Container Apps and walk through example ARM templates to demonstrate how to deploy them within an Azure environment.

July 24, 2025

by Siri Varma Vegiraju

CORE

· 3,177 Views

The Hidden Bias in AI: How Data Shapes the Ethics of Machine Learning

AI bias stems from flawed data. It can be reduced through diverse datasets, fairness checks, transparency, and ethical guidelines to ensure AI aligns with human values.

July 24, 2025

by Arjun S.

· 1,913 Views · 1 Like

Why Data Privacy Without Context Will No Longer Work in 2026

Traditional anonymization is no longer enough. Learn why enterprises now need context-aware, entity-level privacy to stay compliant and operational.

July 24, 2025

by Mouli Srini

· 2,091 Views · 3 Likes

What Is Availability? Theory, Problems, Tools, and Best Practices

What is availability? Today, I will answer that question, dive into challenges, and share best practices related to availability.

July 24, 2025

by Bartłomiej Żyliński

CORE

· 2,466 Views · 2 Likes

Building a Modern Data Platform That Delivers Real Business Value

Data modernization transforms how organizations manage and use data by aligning cloud-native tech, governance, and culture to drive value and agility.

July 23, 2025

by Amlan Patnaik

· 2,286 Views · 2 Likes

Configuring Model Context Protocol (MCP) With Amazon Q CLI

In this post I share how MCP Servers can help provide better context with Amazon Q CLI, a next generation AI Coding Assistant

July 23, 2025

by Ricardo Sueiras

· 5,237 Views · 1 Like

The Latest Data Engineering Topics