DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Big Data Topics

article thumbnail
Building a Reactive Event-Driven App With Dead Letter Queue
Learn how to build fault-tolerant, reactive event-driven applications using Spring WebFlux, Apache Kafka, and Dead Letter Queue to handle data loss efficiently.
January 20, 2025
by Sulakshana Singh
· 5,090 Views · 4 Likes
article thumbnail
Dark Data: Recovering the Lost Opportunities
Dark data is the vast amounts of unstructured information collected by organizations that often go unused. It includes emails, customer interactions, sensor data, etc.
January 17, 2025
by Vijay Singh Khatri DZone Core CORE
· 3,686 Views
article thumbnail
Efficient Long-Term Trend Analysis in Presto Using Datelists
To make long-term trend analysis easier, we can leverage datelists, where we store each metric value corresponding to a date in an array in a sequential manner.
January 15, 2025
by Ajay Krishnan Prabhakaran
· 4,322 Views
article thumbnail
Kafka vs NATS: A Comparison for Message Processing
Kafka and NATS are both popular tools for message processing. This article provides a comparison between Kafka and NATS.
January 15, 2025
by Josson Paul Kalapparambath
· 8,030 Views · 2 Likes
article thumbnail
Data-First IDP: Driving AI Innovation in Developer Platforms
A Data-First IDP integrates governance, traceability, and quality into workflows, transforming how data is managed, enabling scalable, AI-ready ecosystems.
January 15, 2025
by Paul Gale
· 6,646 Views · 2 Likes
article thumbnail
Custom SCD2 Implementation Using PySpark
Learn to implement Slowly Changing Dimension Type 2 (SCD2) in a data warehouse for tracking historical data, ensuring data integrity, and enabling scalability.
January 13, 2025
by Abhishek Trehan
· 4,697 Views · 1 Like
article thumbnail
Process Mining Key Elements
This article introduces process mining, explaining its key elements and practical applications for discovering and analyzing workflows using event data.
January 13, 2025
by Puneet Malhotra
· 4,893 Views · 5 Likes
article thumbnail
Revolutionizing Catalog Management for Data Lakehouse With Polaris Catalog
Achieve cross-query-engine interoperability and zero-data-copy architecture with Polaris Catalog, enhance data management, and streamline workflows.
January 10, 2025
by Dipankar Saha
· 4,280 Views · 1 Like
article thumbnail
Quantum Machine Learning for Large-Scale Data-Intensive Applications
This article examines how QML can harness the principles of quantum mechanics to achieve significant computational advantages over classical approaches.
January 9, 2025
by Manasi Sharma
· 8,006 Views · 1 Like
article thumbnail
AI Governance: Building Ethical and Transparent Systems for the Future
This article takes a deep dive into AI governance, including insights surrounding its challenges, frameworks, standards, and more.
January 9, 2025
by Sukanya Konatam
· 8,561 Views · 3 Likes
article thumbnail
Top 5 Key Features of Apache Iceberg for Modern Data Lakes
Gain insight into key Iceberg features such as time travel, schema evolution, partition evolution, and ACID transactions with clear SQL examples and diagrams.
January 8, 2025
by Rajanikantarao Vellaturi
· 4,996 Views · 4 Likes
article thumbnail
Understanding WebRTC Security Architecture and IoT
Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.
January 8, 2025
by Carsten Rhod Gregersen
· 7,033 Views · 1 Like
article thumbnail
Data Governance Challenges in the Age of Generative AI
Navigate privacy, security, and compliance challenges for innovation. Effective data governance is now more critical due to recent generative AI developments.
January 7, 2025
by nishchai jayanna manjula
· 7,054 Views · 3 Likes
article thumbnail
The Evolution of Adaptive Frameworks
Adaptive frameworks revolutionize collaboration by providing real-time, personalized updates that address traditional tool limitations.
January 6, 2025
by Manasi Sharma
· 3,949 Views · 2 Likes
article thumbnail
Efficiently Processing Billions of Rows Daily With Presto
In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.
January 6, 2025
by Ajay Krishnan Prabhakaran
· 5,557 Views · 3 Likes
article thumbnail
Setting Up Local Kafka Container for Spring Boot Application
Set up Kafka container for Spring Boot application, which covers container configuration, Docker Desktop, and Spring Boot integration.
January 6, 2025
by Amol Gote DZone Core CORE
· 6,648 Views · 4 Likes
article thumbnail
Event-Driven AI: Building a Research Assistant With Kafka and Flink
Learn about the development of an AI-powered research assistant created to help prepare for podcast interviews.
January 6, 2025
by Sean Falconer
· 3,592 Views · 3 Likes
article thumbnail
Incremental Jobs and Data Quality Are On a Collision Course
Big data isn’t dead; it’s just going incremental. But bad things happen when uncontrolled changes collide with incremental jobs. Reacting to changes is a losing strategy.
January 1, 2025
by Jack Vanlightly
· 6,066 Views · 1 Like
article thumbnail
Streamlining Database Management: Running PostgreSQL in Docker Containers
You will learn how to run PostgreSQL in a Docker container with a portable, isolated, and resource-efficient database setup that is easy to manage and scalable.
December 31, 2024
by VARUNREDDY DEVIREDDY
· 7,038 Views · 3 Likes
article thumbnail
Iceberg Catalogs: A Guide for Data Engineers
Learn about Apache Iceberg catalogs, their types, configurations, and the best-fit solutions for managing metadata and large datasets in different environments.
December 31, 2024
by Naresh Dulam
· 7,135 Views · 2 Likes
  • Previous
  • ...
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×