Big Data Resources

Telemetry Pipelines Workshop: Integrating Fluent Bit With OpenTelemetry, Part 2

Take a look at integrating Fluent Bit with OpenTelemetry for use cases where this connectivity in your telemetry data infrastructure is essential.

September 2, 2024

by Eric D. Schabell

CORE

· 6,886 Views · 2 Likes

Building Product to Learn AI, Part 3: Taste Testing and Evaluating

Before our AI meal planner is complete, one crucial step remains: a taste test. This is where a robust evaluation framework becomes your most valuable tool.

September 2, 2024

by Indrajit Bhattacharya

· 3,466 Views · 2 Likes

Best Practices for Salesforce Data Management and Security

Are you doing enough to ensure data security while adhering to data hygiene best practices? Here, learn Salesforce data management and security best practices.

September 2, 2024

by Ilya Dudkin

CORE

· 3,819 Views · 1 Like

High Fidelity Data: Balancing Privacy and Usage

Explore High Fidelity (HiFi) Data features such as visual, population, statistical, and ownership integrity, and its use to balance privacy and usability.

August 29, 2024

by Zilong Tang

· 6,181 Views · 4 Likes

Effortless Concurrency: Leveraging the Actor Model in Financial Transaction Systems

Learn challenges of financial transaction systems and implement robust mechanisms to handle concurrency effectively to ensure system integrity and reliability.

August 8, 2024

by Nikita Melnikov

· 32,378 Views · 6 Likes

Maximizing Enterprise Data: Unleashing the Productive Power of AI With the Right Approach

Learn how organizations can unlock the full potential of their AI initiatives by considering critical elements such as infrastructure, cost, and more.

August 26, 2024

by Pan Singh Dhoni

· 5,386 Views · 1 Like

Methodcentipede

See an example of an antipattern that can lead to difficulties in maintaining and testing code and approaches that allow you to structure your work in a preventative way.

August 26, 2024

by Anton Belyaev

· 9,305 Views · 3 Likes

The Role of Data Governance in Data Strategy: Part 3

Following our look into the enhancement of data in an org, explore Data Subject Access Rights (DSAR) and their correlation to individual rights in real-time.

August 23, 2024

by Satish Gaddipati

· 5,105 Views · 3 Likes

Integrating Apache Kafka in KRaft Mode With RisingWave for Event Stream Processing

Install and configure the latest version of Apache Kafka on a single-node cluster running on Ubuntu-22.04, and subsequently integrate it with RisingWave.

August 23, 2024

by Gautam Goswami

CORE

· 5,267 Views · 3 Likes

Data Pipeline Techniques in Action

Take a deep dive into the architectural concepts of data pipelines along with a hands-on tutorial for implementation, demonstrating the concepts in action.

August 21, 2024

by Sohil Shah

· 7,232 Views · 2 Likes

Preventing and Fixing Bad Data in Event Streams: Part 2

The techniques we use for dealing with bad data in event streams differ from those in the batch world. Here, learn more about overcoming bad data in streaming.

August 21, 2024

by Adam Bellemare

· 6,607 Views · 3 Likes

Mastering PUE for Unmatched Data Center Performance

PUE can make or break data center energy efficiency. Improving this figure will help your facility lower costs and become more sustainable.

August 20, 2024

by Emily Newton

· 4,680 Views · 1 Like

Understanding PolyBase and External Stages: Making Informed Decisions for Data Querying

Explore the differences and strengths of PolyBase and Snowflake external tables to optimize data querying strategies and achieve efficient data integration.

August 19, 2024

by Harshavardhan Yedla

· 5,168 Views · 2 Likes

Data Pipeline vs. ETL Pipeline

Understand the key differences, use cases, and best practices for real-time data processing and batch data integration.

August 15, 2024

by Pier-Jean MALANDRINO

CORE

· 7,613 Views · 4 Likes

Essential Guidelines for Building Optimized ETL Data Pipelines in the Cloud With Azure Data Factory

Discover how to optimize Azure Data Factory pipelines by selecting the right activities and managing resources for reliable data processing.

August 14, 2024

by Aravind Nuthalapati

CORE

· 37,657 Views · 5 Likes

DynamoDB: How to Move Out

Cover specific characteristics related to DynamoDB migrations and strategies employed to integrate with and migrate data seamlessly to other databases.

August 12, 2024

by Felipe Mendes

· 6,537 Views · 4 Likes

Data Fusion: Enhancing Interoperability, Privacy, and Security

Big Data alone isn't enough; quality and integration are key. Discover how data fusion enhances efficiency and decision-making in AI systems.

August 12, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,820 Views · 2 Likes

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 6,329 Views · 1 Like

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 5,909 Views · 1 Like

Batch vs. Real-Time Processing: Understanding the Differences

Learn the differences between batch and real-time data processing, and explore the decision-making factors for choosing the right approach to optimize data pipelines.

August 8, 2024

by Stelios Manioudakis

CORE

· 17,140 Views · 3 Likes

The Latest Big Data Topics