Data Engineering Resources

AI’s bugs aren’t code errors but symptoms of a broken 'mind.' LLMs show psychopathic traits: fragmented selves, weak brakes, and reward obsession.

September 9, 2025

by Taras Baranyuk

CORE

· 2,847 Views

Cloud Automation Excellence: Terraform, Ansible, and Nomad for Enterprise Architecture

Enterprise cloud architecture demands sophisticated orchestration of infrastructure, configuration, and workload management across diverse computing platforms.

September 9, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,603 Views · 3 Likes

Toward Explainable AI (Part 8): Bridging Theory and Practice—SHAP: Powerful, But Can We Trust It?

Explainable AI bridges the gap between complex models and real-world accountability, helping teams build trust, ensure compliance, and make smarter decisions.

September 9, 2025

by Frederic Jacquet

CORE

· 1,579 Views · 2 Likes

Replacing LEADTOOLS Scanner With AWS Textract (Step-by-Step Migration)

LEADTOOLS is a scanning tool that needs to be migrated to the AWS Cloud using an equivalent service, such as AWS Textract, for real-time document scanning.

September 8, 2025

by Prabhakar Mishra

· 2,556 Views · 1 Like

Stop Your GenAI From Burning Cash in Production

GenAI in production is expensive, but most teams waste 60-80% of their budget on preventable mistakes. Five proven optimizations that cut costs by 40-75%

September 8, 2025

by Praveen Chinnusamy

· 24,350 Views · 4 Likes

Building an AI-Powered Insurance Q and A Assistant With RAG and Snowflake Cortex

This project shows how to create an AI-powered insurance Q&A assistant using Retrieval-Augmented Generation and Snowflake Cortex Search for accurate answers.

September 8, 2025

by munikrishnaiah sundararamaiah

· 1,410 Views · 2 Likes

API Design First: AsyncAPI in .Net

AsyncAPI isn't as widely adopted as OpenAPI Spec, however, it's getting significant attention in the world of everything async and distributed.

September 8, 2025

by Shashi Kumar

· 2,416 Views · 2 Likes

Getting Started With ClickHouse for AI/ML in Python

ClickHouse is a high-performance, column-oriented OLAP database designed to handle petabyte-scale data with lightning-fast query execution.

September 8, 2025

by Devdas Gupta

· 2,402 Views · 3 Likes

Building a Platform Abstraction for AWS Networks Using Crossplane

Build Crossplane abstractions that let your devs request AWS networks without writing infrastructure code. Create XRD and composition to hide details.

September 5, 2025

by Ramesh Sinha

· 3,138 Views · 1 Like

Meta Prompting for Agile Practitioners

Learn how meta prompting turns AI into a partner for Retrospective prep—shaping context-rich dialogue while keeping facilitation a human skill.

September 5, 2025

by Stefan Wolpers

CORE

· 2,314 Views · 3 Likes

Making String Search Easier Across Databases

Users rarely remember exact strings. Partial search with fragments—beginnings, endings, or keywords—has become crucial for systems like e-commerce and finance.

September 5, 2025

by Otavio Santana

CORE

· 3,372 Views · 2 Likes

Measuring What Matters: A Strategic Lens on Transformation Metrics

Track Agile-DevOps and AI-first transformations effectively by selecting the right metrics—balancing output/outcome, leading/lagging, and subjective/objective measures.

September 5, 2025

by Suman Das

· 2,774 Views · 2 Likes

The Role of Data Governance in Data Strategy: Part 4

Explore the critical role of data retention in governance: reduce costs, mitigate legal and cybersecurity risks, and ensure compliance with clear policies.

September 5, 2025

by Satish Gaddipati

· 2,312 Views · 2 Likes

Change Data Capture for Apache Phoenix Stream

Apache Phoenix, a relational low latency, high throughput database backed by Apache HBase has implemented Change Data Capture. Learn the details of the CDC Streaming.

September 5, 2025

by Viraj Jasani

· 2,676 Views · 4 Likes

Build a RAG Application With LangChain and Local LLMs Powered by Ollama

Learn how to run local LLMs with Ollama and Azure Cosmos DB for RAG, ensuring data privacy, offline use, and full control of your AI workflow.

September 5, 2025

by Abhishek Gupta

CORE

· 3,361 Views · 1 Like

Toward Explainable AI (Part 7): Bridging Theory and Practice—SHAP: Bringing Clarity to Financial Decision-Making

Explainable AI bridges the gap between complex models and real-world accountability, helping teams build trust, ensure compliance, and make smarter decisions.

September 5, 2025

by Frederic Jacquet

CORE

· 3,464 Views · 2 Likes

How to Use AI to Enhance Scrum Ceremonies

This article cites some trends on Scrum and AI usage and provides details on how AI tools can help automate Scrum ceremonies without impacting human values.

September 4, 2025

by Arpit Garg

· 3,796 Views · 2 Likes

Protecting PII in LLM Applications: A Complete Guide to Data Anonymization

One of the biggest concerns companies face when implementing Large Language Models (LLMs) is data privacy and protection.

September 4, 2025

by Swati Tyagi

· 13,160 Views · 1 Like

Building AI Agents? 5 Critical Questions to Ask Before You Automate

Five essential questions to ask before deploying AI agents, focused on data, context, trust, governance, and real-world readiness.

September 4, 2025

by Pradeep Kumar Sharma

· 2,311 Views

Take AI Out of Your Silos—Why Team Experience Trumps Developer Tools

Stop optimizing individual dev tools with AI. Team workflows need AI that carries context end-to-end, not another siloed copilot that makes you its secretary.

September 4, 2025

by Michael Smith

· 1,771 Views · 1 Like

The Latest Data Engineering Topics