Data Engineering Resources

Deploying Containers on Azure Container Apps

In this article, we’ll explore Azure Container Apps and walk through example ARM templates to demonstrate how to deploy them within an Azure environment.

July 24, 2025

by Siri Varma Vegiraju

CORE

· 3,108 Views

The Hidden Bias in AI: How Data Shapes the Ethics of Machine Learning

AI bias stems from flawed data. It can be reduced through diverse datasets, fairness checks, transparency, and ethical guidelines to ensure AI aligns with human values.

July 24, 2025

by Arjun S.

· 1,842 Views · 1 Like

Why Data Privacy Without Context Will No Longer Work in 2026

Traditional anonymization is no longer enough. Learn why enterprises now need context-aware, entity-level privacy to stay compliant and operational.

July 24, 2025

by Mouli Srini

· 2,029 Views · 3 Likes

What Is Availability? Theory, Problems, Tools, and Best Practices

What is availability? Today, I will answer that question, dive into challenges, and share best practices related to availability.

July 24, 2025

by Bartłomiej Żyliński

CORE

· 2,426 Views · 2 Likes

Building a Modern Data Platform That Delivers Real Business Value

Data modernization transforms how organizations manage and use data by aligning cloud-native tech, governance, and culture to drive value and agility.

July 23, 2025

by Amlan Patnaik

· 2,229 Views · 2 Likes

Configuring Model Context Protocol (MCP) With Amazon Q CLI

In this post I share how MCP Servers can help provide better context with Amazon Q CLI, a next generation AI Coding Assistant

July 23, 2025

by Ricardo Sueiras

· 5,202 Views · 1 Like

[Part-3] Text to Action: Adding Voice Control to Your Smart Calendar

In Part 3 of “Text to Action,” we add voice commands to our calendar assistant, converting speech to events using the Web Speech API and NLP pipeline.

July 23, 2025

by Vivek Vellaiyappan Surulimuthu

· 1,927 Views · 1 Like

Building Resilient Event-Driven Applications Using Temporal

Temporal simplifies building resilient, event-driven applications by handling retries, failures, and state management without external tools.

July 23, 2025

by Lakshmi Narayana Rasalay

· 4,379 Views · 2 Likes

Designing Retry-Resilient Fare Pipelines With Idempotent Event Handling

Design retry-safe fare pipelines with idempotent event handling to ensure consistency across failures, retries, and duplications.

July 23, 2025

by Ravi Teja Thutari

CORE

· 3,193 Views · 2 Likes

Automating a Web Form With Playwright MCP and MySQL MCP

Learn how to automate form filling using Playwright MCP and MySQL MCP by fetching real-time data from a database with minimal scripting.

July 23, 2025

by Kailash Pathak

CORE

· 3,302 Views

Software Engineering Trade-Offs: Why We Cannot Build the Perfect

Our job is to focus on min-maxing software engineering trade-offs to achieve the best result. I am sharing thoughts and practices on how to do it.

July 23, 2025

by Bartłomiej Żyliński

CORE

· 1,628 Views · 7 Likes

Implementing Least Privilege in AWS IAM: Principles, Practices, and Automation

Applying least privilege in AWS IAM helps reduce risk, improve compliance, and secure environments by granting only necessary permissions to users and services.

July 22, 2025

by Ishwar Bansal

· 3,901 Views · 2 Likes

Building a Multi Tenancy Platform Using Camunda

This guide shows how to build a multi-tenant platform using Camunda BPM, covering AWS deployment, tenant isolation, upgrades, observability, and scaling best practices.

July 22, 2025

by Lakshmi Narayana Rasalay

· 1,691 Views · 1 Like

Agile-Based Fine-Tuning of AI Agents for Domain-Specific User Feedback Loops

Think of agile fine-tuning as giving your AI a feedback loop and a sprint plan. It helps models stay accurate, adapt to real-world shifts, and serve users better, faster.

July 22, 2025

by Raja Manambedu Vijayakumar

· 2,467 Views · 1 Like

Debugging Distributed Flight Search: What Logs Alone Won’t Tell You

Logs aren’t enough. Learn how tracing, metrics, and correlation IDs help debug fare mismatches in distributed flight search systems.

July 22, 2025

by Ravi Teja Thutari

CORE

· 2,045 Views · 3 Likes

6 Ways AI-Enhanced Phishing Can Hijack Developer Workflows (and What to Do About It)

Phishing has evolved into a major supply chain security threat, targeting software developers with attacks on development tools and workflows.

July 21, 2025

by Philip Piletic

CORE

· 3,040 Views · 3 Likes

Reasoning Models Explained: What They Are, How They Work, and When to Use Them Over Traditional LLMs

Knowing when to choose a reasoning model over a more traditional LLM is essential for maximizing cost and efficiency, and delivering the required level of accuracy.

July 21, 2025

by Adam Lieberman

· 3,217 Views

Implementing Data Analytics in Healthcare: A Hands-On Approach

Success in healthcare data analytics requires cleaning and integrating data, ensuring privacy, and starting small before scaling up.

July 21, 2025

by Mykhailo Kopyl

· 1,505 Views · 2 Likes

Today’s Platform Engineer Needs to Build AI-Ready Infrastructure

Platform engineers must go beyond DevOps to build unified, AI-ready infrastructure with seamless data access, strong governance, and cost efficiency.

July 21, 2025

by Sijie Guo

· 2,840 Views · 2 Likes

Automation of IT Incident Reports Using Observability API and GenAI

A summary of the integration of observability API and GenAI to automate preliminary incident reporting with a sample incident report from on-prem and cloud models.

July 18, 2025

by Pandian Ramaiah

· 3,567 Views

The Latest Data Engineering Topics