Data Engineering Resources

AsyncAPI isn't as widely adopted as OpenAPI Spec, however, it's getting significant attention in the world of everything async and distributed.

September 8, 2025

by Shashi Kumar

· 2,274 Views · 2 Likes

Getting Started With ClickHouse for AI/ML in Python

ClickHouse is a high-performance, column-oriented OLAP database designed to handle petabyte-scale data with lightning-fast query execution.

September 8, 2025

by Devdas Gupta

· 2,226 Views · 3 Likes

Building a Platform Abstraction for AWS Networks Using Crossplane

Build Crossplane abstractions that let your devs request AWS networks without writing infrastructure code. Create XRD and composition to hide details.

September 5, 2025

by Ramesh Sinha

· 2,962 Views · 1 Like

Meta Prompting for Agile Practitioners

Learn how meta prompting turns AI into a partner for Retrospective prep—shaping context-rich dialogue while keeping facilitation a human skill.

September 5, 2025

by Stefan Wolpers

CORE

· 2,216 Views · 3 Likes

Making String Search Easier Across Databases

Users rarely remember exact strings. Partial search with fragments—beginnings, endings, or keywords—has become crucial for systems like e-commerce and finance.

September 5, 2025

by Otavio Santana

CORE

· 3,227 Views · 2 Likes

Measuring What Matters: A Strategic Lens on Transformation Metrics

Track Agile-DevOps and AI-first transformations effectively by selecting the right metrics—balancing output/outcome, leading/lagging, and subjective/objective measures.

September 5, 2025

by Suman Das

· 2,622 Views · 2 Likes

The Role of Data Governance in Data Strategy: Part 4

Explore the critical role of data retention in governance: reduce costs, mitigate legal and cybersecurity risks, and ensure compliance with clear policies.

September 5, 2025

by Satish Gaddipati

· 2,194 Views · 2 Likes

Change Data Capture for Apache Phoenix Stream

Apache Phoenix, a relational low latency, high throughput database backed by Apache HBase has implemented Change Data Capture. Learn the details of the CDC Streaming.

September 5, 2025

by Viraj Jasani

· 2,564 Views · 4 Likes

Build a RAG Application With LangChain and Local LLMs Powered by Ollama

Learn how to run local LLMs with Ollama and Azure Cosmos DB for RAG, ensuring data privacy, offline use, and full control of your AI workflow.

September 5, 2025

by Abhishek Gupta

CORE

· 3,224 Views · 1 Like

Toward Explainable AI (Part 7): Bridging Theory and Practice—SHAP: Bringing Clarity to Financial Decision-Making

Explainable AI bridges the gap between complex models and real-world accountability, helping teams build trust, ensure compliance, and make smarter decisions.

September 5, 2025

by Frederic Jacquet

CORE

· 3,178 Views · 2 Likes

How to Use AI to Enhance Scrum Ceremonies

This article cites some trends on Scrum and AI usage and provides details on how AI tools can help automate Scrum ceremonies without impacting human values.

September 4, 2025

by Arpit Garg

· 3,573 Views · 2 Likes

Protecting PII in LLM Applications: A Complete Guide to Data Anonymization

One of the biggest concerns companies face when implementing Large Language Models (LLMs) is data privacy and protection.

September 4, 2025

by Swati Tyagi

· 12,224 Views · 1 Like

Building AI Agents? 5 Critical Questions to Ask Before You Automate

Five essential questions to ask before deploying AI agents, focused on data, context, trust, governance, and real-world readiness.

September 4, 2025

by Pradeep Kumar Sharma

· 2,116 Views

Take AI Out of Your Silos—Why Team Experience Trumps Developer Tools

Stop optimizing individual dev tools with AI. Team workflows need AI that carries context end-to-end, not another siloed copilot that makes you its secretary.

September 4, 2025

by Michael Smith

· 1,707 Views · 1 Like

Active Learning and Human-in-the-Loop for NLP Annotation and Model Improvement

A practical guide to using active learning and human-in-the-loop workflows for efficient NLP annotation, model training, and continuous improvement.

September 4, 2025

by Surya Teja Appini

· 2,448 Views · 5 Likes

Developing a Nationwide Real-Time Telemetry Analytics Platform Using Google Cloud Platform and Apache Airflow

Designed a real-time telemetry analytics platform using GCP and Airflow to process 10TB+ daily data, reduce support escalations, and improve operational visibility.

September 3, 2025

by Sruthi Erra Hareram

· 2,857 Views · 2 Likes

DSLs vs. Libraries: Evaluating Language Design in the GenAI Era

Compare general-purpose and domain-specific languages, their AI-driven evolution, and how they optimize data pipelines and trading workflows efficiently.

September 3, 2025

by Raghav Talwar

· 2,826 Views · 1 Like