Data Resources

Custom SCD2 Implementation Using PySpark

Learn to implement Slowly Changing Dimension Type 2 (SCD2) in a data warehouse for tracking historical data, ensuring data integrity, and enabling scalability.

January 13, 2025

by Abhishek Trehan

· 2,393 Views · 1 Like

Process Mining Key Elements

This article introduces process mining, explaining its key elements and practical applications for discovering and analyzing workflows using event data.

January 13, 2025

by Puneet Malhotra

· 3,637 Views · 5 Likes

Enterprise RAG in Amazon Bedrock: Introduction to KnowledgeBases

In this post, learn details of Amazon Bedrock KnowledgeBases capability and how to build a serverless RAG pipeline using KnowledgeBases.

January 13, 2025

by Suvoraj Biswas

· 2,878 Views · 1 Like

Revolutionizing Catalog Management for Data Lakehouse With Polaris Catalog

Achieve cross-query-engine interoperability and zero-data-copy architecture with Polaris Catalog, enhance data management, and streamline workflows.

January 10, 2025

by Dipankar Saha

· 3,199 Views · 1 Like

Quantum Machine Learning for Large-Scale Data-Intensive Applications

This article examines how QML can harness the principles of quantum mechanics to achieve significant computational advantages over classical approaches.

January 9, 2025

by Manasi Sharma

· 6,541 Views · 1 Like

AI Governance: Building Ethical and Transparent Systems for the Future

This article takes a deep dive into AI governance, including insights surrounding its challenges, frameworks, standards, and more.

January 9, 2025

by Sukanya Konatam

· 7,130 Views · 2 Likes

Visualizing the Air Quality Index (AQI) Across Punjab, Pakistan, and India

Learn how to use IQAir data for visualizing air quality in Punjab to gain insight into the widespread impact of air pollution across the region.

January 8, 2025

by Akmal Chaudhri

CORE

· 3,319 Views

Top 5 Key Features of Apache Iceberg for Modern Data Lakes

Gain insight into key Iceberg features such as time travel, schema evolution, partition evolution, and ACID transactions with clear SQL examples and diagrams.

January 8, 2025

by Rajanikantarao Vellaturi

· 3,656 Views · 2 Likes

API and Security: From IT to Cyber

Learn how to protect your APIs beyond the basics. This article explores the risks, but also the solutions, which are not necessarily limited to the API Manager.

January 8, 2025

by Thomas Jardinet

CORE

· 5,202 Views · 2 Likes

Understanding WebRTC Security Architecture and IoT

Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.

January 8, 2025

by Carsten Rhod Gregersen

· 5,665 Views · 1 Like

Pathway to Legacy Application Retirement

This article looks at application retirement from a data perspective, best practices, challenges, and how to manage and leverage data during this process.

January 7, 2025

by Abhik Choudhury

· 3,247 Views · 2 Likes

A Deep Dive on Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 7, 2025

by Ganapathy Subramanian Ramachandran

· 5,390 Views · 3 Likes

The Evolution of Adaptive Frameworks

Adaptive frameworks revolutionize collaboration by providing real-time, personalized updates that address traditional tool limitations.

January 6, 2025

by Manasi Sharma

· 2,905 Views · 2 Likes

Achieving Security and Trust in a Data Fabric: The Role of Zero Trust Architecture

Explore how zero-trust architecture (ZTA) can provide a solid foundation for achieving security and trust in a data fabric.

January 6, 2025

by Julian Durand

· 4,242 Views · 3 Likes

Efficiently Processing Billions of Rows Daily With Presto

In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.

January 6, 2025

by Ajay Krishnan Prabhakaran

· 4,296 Views · 3 Likes

Revolutionize Stream Processing With Data Fabric

An open-source distributed event-streaming platform like Apache Kafka supports data fabric by handling real-time data streaming across various systems.

January 6, 2025

by Gautam Goswami

CORE

· 3,054 Views · 3 Likes

Demystifying Big O Notation

Big O Notation is probably going to be the first thing you hear about when learning about data structures and algorithms. Let's make it easy to understand.

January 3, 2025

by Jesse Price

· 3,525 Views · 5 Likes

Avoiding If-Else: Advanced Approaches and Alternatives

Skip if-else statements by using design patterns, polymorphism, and functional strategies for cleaner, more adaptable, and significantly more testable code architectures.

January 2, 2025

by Taras Ivashchuk

· 9,447 Views · 14 Likes

Incremental Jobs and Data Quality Are On a Collision Course

Big data isn’t dead; it’s just going incremental. But bad things happen when uncontrolled changes collide with incremental jobs. Reacting to changes is a losing strategy.

January 1, 2025

by Jack Vanlightly

· 5,051 Views · 1 Like

Iceberg Catalogs: A Guide for Data Engineers

Learn about Apache Iceberg catalogs, their types, configurations, and the best-fit solutions for managing metadata and large datasets in different environments.

December 31, 2024

by Naresh Dulam

· 5,066 Views · 2 Likes

The Latest Data Topics