Big Data Resources

Keeping Two Multi-Master Databases Aligned With a Vector Clock

In this article, learn about an experience in keeping two different databases aligned with two different technologies by using an application-level solution.

September 5, 2024

by Claudio Guidi

CORE

· 7,097 Views · 4 Likes

Setting Up a Data Warehouse for Starlight: A Comprehensive Guide

Learn architectural considerations, essential tools, and technologies, and see sample code snippets to illustrate key steps of a data warehouse setup.

September 5, 2024

by Harsh Daiya

CORE

· 4,329 Views · 1 Like

How to Conduct Effective Data Security Audits for Big Data Systems

Learn key strategies for conducting thorough data security audits in big data systems to safeguard sensitive information.

September 4, 2024

by Devin Partida

· 5,611 Views · 1 Like

MLOps: How to Build a Toolkit to Boost AI Project Performance

AI projects could end up among the 90% that fail due to common implementation pitfalls. Here, learn how to change the game with the right MLOps tools.

September 3, 2024

by Alexander Simonov

· 7,394 Views · 4 Likes

Open Standards for Data Lineage: OpenLineage for Batch and Streaming

Explores trends and efforts to provide an open standard with OpenLineage, and how data governance solutions help fulfill enterprise-wide data governance needs.

September 3, 2024

by Kai Wähner

CORE

· 6,576 Views · 1 Like

Confusion Matrix vs. ROC Curve: When to Use Which for Model Evaluation

The Confusion Matrix and the ROC Curve evaluate model performance in machine learning and data science. Compare and learn when to use each in model evaluation.

September 3, 2024

by Fizza Jatniwala

· 7,190 Views · 1 Like

Telemetry Pipelines Workshop: Integrating Fluent Bit With OpenTelemetry, Part 2

Take a look at integrating Fluent Bit with OpenTelemetry for use cases where this connectivity in your telemetry data infrastructure is essential.

September 2, 2024

by Eric D. Schabell

CORE

· 6,923 Views · 2 Likes

Building Product to Learn AI, Part 3: Taste Testing and Evaluating

Before our AI meal planner is complete, one crucial step remains: a taste test. This is where a robust evaluation framework becomes your most valuable tool.

September 2, 2024

by Indrajit Bhattacharya

· 3,493 Views · 2 Likes

Best Practices for Salesforce Data Management and Security

Are you doing enough to ensure data security while adhering to data hygiene best practices? Here, learn Salesforce data management and security best practices.

September 2, 2024

by Ilya Dudkin

CORE

· 3,857 Views · 1 Like

High Fidelity Data: Balancing Privacy and Usage

Explore High Fidelity (HiFi) Data features such as visual, population, statistical, and ownership integrity, and its use to balance privacy and usability.

August 29, 2024

by Zilong Tang

· 6,216 Views · 4 Likes

Effortless Concurrency: Leveraging the Actor Model in Financial Transaction Systems

Learn challenges of financial transaction systems and implement robust mechanisms to handle concurrency effectively to ensure system integrity and reliability.

August 28, 2024

by Nikita Melnikov

· 32,612 Views · 6 Likes

Maximizing Enterprise Data: Unleashing the Productive Power of AI With the Right Approach

Learn how organizations can unlock the full potential of their AI initiatives by considering critical elements such as infrastructure, cost, and more.

August 26, 2024

by Pan Singh Dhoni

· 5,427 Views · 1 Like

Methodcentipede

See an example of an antipattern that can lead to difficulties in maintaining and testing code and approaches that allow you to structure your work in a preventative way.

August 26, 2024

by Anton Belyaev

· 9,329 Views · 3 Likes

The Role of Data Governance in Data Strategy: Part 3

Following our look into the enhancement of data in an org, explore Data Subject Access Rights (DSAR) and their correlation to individual rights in real-time.

August 23, 2024

by Satish Gaddipati

· 5,148 Views · 3 Likes

Integrating Apache Kafka in KRaft Mode With RisingWave for Event Stream Processing

Install and configure the latest version of Apache Kafka on a single-node cluster running on Ubuntu-22.04, and subsequently integrate it with RisingWave.

August 23, 2024

by Gautam Goswami

CORE

· 5,301 Views · 3 Likes

Data Pipeline Techniques in Action

Take a deep dive into the architectural concepts of data pipelines along with a hands-on tutorial for implementation, demonstrating the concepts in action.

August 21, 2024

by Sohil Shah

· 7,267 Views · 2 Likes

Preventing and Fixing Bad Data in Event Streams: Part 2

The techniques we use for dealing with bad data in event streams differ from those in the batch world. Here, learn more about overcoming bad data in streaming.

August 21, 2024

by Adam Bellemare

· 6,633 Views · 3 Likes

Mastering PUE for Unmatched Data Center Performance

PUE can make or break data center energy efficiency. Improving this figure will help your facility lower costs and become more sustainable.

August 20, 2024

by Emily Newton

· 4,728 Views · 1 Like

Understanding PolyBase and External Stages: Making Informed Decisions for Data Querying

Explore the differences and strengths of PolyBase and Snowflake external tables to optimize data querying strategies and achieve efficient data integration.

August 19, 2024

by Harshavardhan Yedla

· 5,248 Views · 2 Likes

Data Pipeline vs. ETL Pipeline

Understand the key differences, use cases, and best practices for real-time data processing and batch data integration.

August 15, 2024

by Pier-Jean MALANDRINO

CORE

· 7,650 Views · 4 Likes

The Latest Big Data Topics