Data Resources

Best Practices for Migrating Data From Legacy Systems With AI

In this article, I will share my experience with AI-powered data migration, including what worked well and key lessons learned along the way.

November 14, 2025

by Mykhailo Kopyl

· 3,296 Views · 4 Likes

Databricks vs Snowflake: Complete Architecture Mapping for Enterprise AI and Big Data

This guide maps core data, big data, and AI/ML concepts between Databricks and Snowflake, with examples, diagrams, and a framework for choosing or combining the two.

November 13, 2025

by Ram Ghadiyaram

CORE

· 7,391 Views · 7 Likes

Versioned Caching: A Practical Pattern for High-Performance Lookup Data

A practical guide to versioned caching for static lookup data using cache-control headers, local storage, and data version synchronization between client and server.

November 13, 2025

by Artsiom Lazouski

· 1,862 Views · 1 Like

Compose Architecture, Done Right: MVI’s Unidirectional State vs. MVVM

TL;DR: Compose wants one-way data and a single UiState. MVI delivers that-fewer surprises, cleaner tests, and explicit effects.

November 12, 2025

by Mohan Sankaran

· 2,060 Views · 6 Likes

The DSPM Paradox: Perceived Controls for an Uncontrollable Data Landscape

You can't stop every burglar, but you can ensure your valuables are in a safe they can't crack. Why DSPM tools create an illusion of control in modern data security.

November 12, 2025

by Hamid Akhtar

· 1,303 Views

Decentralized Identity Management: The Future of Privacy and Security

As more of our information goes digital and cybersecurity awareness increases, DIM feels like the natural next step of identity management.

November 11, 2025

by Ben Hartwig

· 3,418 Views · 2 Likes

Event-Driven Architecture Patterns: Real-World Lessons From IoT Development

Real-world lessons on building event-driven systems for IoT and microservices — and model optimization with practical code examples.

November 10, 2025

by Bhavna Hirani

· 7,988 Views · 6 Likes

Hudi vs. Delta vs. Iceberg: How to Choose the Right Lakehouse Table Format

Hudi excels at real-time upserts, Delta handles ACID workloads, and Iceberg supports large-scale analytics with flexible schemas.

November 10, 2025

by harshraj bhoite

· 3,787 Views · 1 Like

Regression Analysis for Time Series Data: Models and Applications

Ready to use regression analysis for time series data? Explore how this method works in practice to effectively predict future outcomes and drive growth.

November 10, 2025

by Oleksandr Stefanovskyi

· 1,660 Views · 1 Like

Unlocking Modernization: SUSE Virtualization on Arm64 With Harvester

Learn about how SUSE Virtualization and Ampere enable energy-efficient cloud modernization with Arm64 support, unifying VMs and containers on one platform.

November 6, 2025

by Craig Hardy

· 3,222 Views · 2 Likes

Master Production-Ready Big Data, Apache Spark Jobs in Databricks and Beyond: An Expert Guide

Refine Apache Spark performance in Databricks with strategies. Includes expert insights, PySpark examples, and diagrams for efficient data processing.

November 6, 2025

by Ram Ghadiyaram

CORE

· 2,105 Views · 1 Like

AIOps to Agentic AIOps: Building Trustworthy Symbiotic Workflows With Human-in-the-Loop LLMs

Build secure, human-in-the-loop AIOps workflows using agentic AI for smart alert triage, context summarization, and automated, safe incident resolution.

November 4, 2025

by Pratik Prakash

CORE

· 3,403 Views

5 Critical Databricks Performance Hacks That Most Engineers Miss (100x Faster Queries)

In this article, learn to boost Databricks' performance with six proven optimization strategies for UDFs, AQE, Delta Lake, broadcasts, and Photon acceleration.

November 3, 2025

by Ram Ghadiyaram

CORE

· 3,495 Views · 4 Likes

Delta Lake 4.0 and Delta Kernel: What's New in the Future of Data Lakehouses

Delta Lake 4.0 pushes the lakehouse forward with flexible schemas, stronger transactions, remote, multi‑engine access, self‑optimizing performance, and AI‑ready storage.

November 3, 2025

by Sairamakrishna BuchiReddy Karri

· 3,594 Views · 2 Likes

Streamlining Real-Time Ad Tech Systems: Techniques to Prevent Performance Bottlenecks

Ad tech platforms depend on microscopic efficiency. Profiling and disciplined logging collectively cut waste and latency, turning scale into sustainable profit.

October 31, 2025

by Jeet Nishit Mehta

· 2,010 Views · 1 Like

When Coalesce Is Slower Than Repartition: A Spark Performance Paradox

In this article, learn why repartition() can outperform coalesce() in Apache Spark — and how Catalyst optimizer pushdown can throttle your job’s parallelism.

October 30, 2025

by Janani Annur Thiruvengadam

CORE

· 2,864 Views · 3 Likes

How to Get a Frequency Table of a Categorical Variable as a Data Frame

Learn how to get a frequency table of a categorical variable as a Data Frame in R using table(), cut(), count(), and plyr — with clean, ready-to-use output.

October 30, 2025

by Chaitanya Sagar

· 1,506 Views · 1 Like

From Autocomplete to Co-Creation: How AI Changes Developing/Debugging Workflows in Engineering

AI is not a replacement for engineers but a powerful partner that accelerates coding, debugging, and learning; human judgment still drives the real innovation.

October 29, 2025

by Aishwarya Murali

· 2,528 Views · 1 Like

End of Static Knowledge Bases? How MCP Enables Live RAG

Learn why static RAG systems fail over time and how the Model Context Protocol (MCP) enables live, hybrid AI architectures that stay accurate and up to date.

October 29, 2025

by Janani Annur Thiruvengadam

CORE

· 2,532 Views · 2 Likes

Debugging a Spark Driver Out of Memory (OOM) Issue With Large JSON Data Processing

This article draws on real-world debugging experience and aims to provide insights into Spark's memory management challenges.

October 29, 2025

by Raju Ansari

· 2,468 Views · 2 Likes

The Latest Data Topics