Data Resources

From LLMs to Agents: How BigID is Enabling Secure Agentic AI for Data Governance

BigID leverages agentic AI to move beyond traditional LLMs, enabling secure, autonomous data discovery, governance, and real-time decision-making at enterprise scale.

January 30, 2026

by Satish Gaddipati

· 2,052 Views · 1 Like

Essential Techniques for Production Vector Search Systems, Part 3: Filterable HNSW

Proven techniques for production vector search, including when to use each one, how to combine them effectively, and trade-offs to understand before deployment.

January 30, 2026

by Pavan Vemuri

CORE

· 1,937 Views · 2 Likes

Preventing Cache Stampedes at Scale

High-concurrency systems — especially retail, travel, ticketing, or any “hot product” scenarios — often face cache stampedes (aka "thundering herd", "dogpiling"). Here's a practical pattern for managing concurrent data requests.

January 29, 2026

by Vikas Mittal

· 1,833 Views

Reliable AI Agent Architecture for Mobile: Timeouts, Retries, and Idempotent Tool Calls

Ship reliable mobile agents: timeout everything, retry by error class, persist steps across restarts, and require idempotency keys for write tools.

January 29, 2026

by Mohan Sankaran

· 2,438 Views · 6 Likes

Zero Trust for Agents: Implementing Context Lineage in the Enterprise Data Mesh

Agent identity and its audit history will enforce zero-trust access for agents based on both identity and past behavior. This makes agent access more secure and reliable.

January 28, 2026

by Anshul Pathak

· 2,243 Views · 1 Like

Building an OCR Data Pipeline: From Unstructured Images to Structured Data

How to treat OCR text as just another data source — build a repeatable ingestion, transformation, and validation workflow for unstructured data.

January 28, 2026

by Punitha Ponnuraj

· 3,408 Views · 1 Like

Generating Schema-Valid Synthetic ISO 20022 Messages for Privacy-Preserving Fraud Detection

Leverage a schema-aware federated approach to generate synthetic ISO 20022 payments data with strict personal information privacy and XSD compliance.

January 28, 2026

by Senthilnathan Dhanasekaran

· 1,377 Views

Building an Internal Document Search Tool with Retrieval-Augmented Generation (RAG)

Retrieval-Augmented Generation (RAG) is transforming enterprise AI by bridging the gap between general-purpose language models and organization-specific knowledge.

January 27, 2026

by Manish Adawadkar

· 3,577 Views

Cost-Aware GenAI Architecture: Caching, Model Routing, and Token Budgets That Don’t Explode

Keep GenAI cheap and fast: cache aggressively, route models by confidence, cap tokens and tools, compress context, and monitor cost per successful outcome.

January 27, 2026

by Mohan Sankaran

· 3,419 Views · 5 Likes

Building Fault-Tolerant Data Pipelines in GCP

This article provides a practical guide to building a fault-tolerant Google Cloud data pipeline architecture with Firestore, Pub/Sub, Dataflow, and BigQuery.

January 26, 2026

by Krishnam Raju Narsepalle

· 1,406 Views

Vibe Coding Part 3 — Building a Data Quality Framework in Scala and PySpark

How GenAI-assisted “vibe coding” can simplify building PySpark wrappers over Scala Spark libraries when you know what you’re doing.

January 23, 2026

by Bipin Patwardhan

· 1,442 Views · 2 Likes

Securing AI/ML Workloads in the Cloud: Integrating DevSecOps with MLOps

ML systems introduce security risks most teams aren’t prepared for. The piece explores emerging ML-specific threats and what effective MLSecOps looks like in practice.

January 23, 2026

by Igboanugo David Ugochukwu

CORE

· 3,158 Views · 1 Like

Design and Implementation of Cloud-Native Microservice Architectures for Scalable Insurance Analytics Platforms

How cloud-native microservices transform insurance analytics by enabling scalability, real-time processing, and seamless modernization of legacy platforms.

January 23, 2026

by Afroz Mohammad

· 2,226 Views · 1 Like

Efficient Sampling Approach for Large Datasets

In this article, we will learn about the central limit theorem and how it helps with random sampling in big-data-related problems.

January 22, 2026

by Rajesh Vakkalagadda

· 1,486 Views

Automating Visual Brand Compliance: A Multimodal LLM Approach

Manual review of marketing assets for brand consistency is a bottleneck. Here is an architectural pattern for building a compliance tool using Multimodal LLMs and Python.

January 22, 2026

by Dippu Kumar Singh

· 2,710 Views

Why Semantic Layers Matter in Analytics: A Deep Dive into RAG Design

Analytics assistants/chatbots should trust the semantic layer — not documents. Retrieve metric definitions, run governed SQL, and attach an audit bundle to every KPI.

January 22, 2026

by Anusha Kovi

CORE

· 1,740 Views · 1 Like

Data Engineering: Strategies for Data Retrieval on Multi-Dimensional Data

A comparative look at partitioning, indexing, clustering, and ordering techniques to match retrieval strategies with real-world query needs.

January 22, 2026

by Avi Yehuda

· 1,476 Views

The Future of Data Streaming with Apache Flink for Agentic AI

Flink and Kafka enable real-time agentic AI by streaming fresh data and model context via the MCP standard for intelligent actions at scale.

January 21, 2026

by Kai Wähner

CORE

· 2,498 Views

Where AI Fits and Fails in Workday Integrations

AI enhances Workday integrations by improving mapping, testing, and monitoring, but it fails when used without human oversight, domain expertise, and strong governance.

January 21, 2026

by Suresh Kurapati

· 2,887 Views · 1 Like

MERGE and Liquid Clustering: Common Performance Issues

A practical look at common pitfalls and performance challenges when using MERGE operations on liquid-clustered Delta tables, and how to avoid them.

January 21, 2026

by Avi Yehuda

· 1,870 Views

The Latest Data Topics