DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Big Data Topics

article thumbnail
Top 5 Key Features of Apache Iceberg for Modern Data Lakes
Gain insight into key Iceberg features such as time travel, schema evolution, partition evolution, and ACID transactions with clear SQL examples and diagrams.
January 8, 2025
by Rajanikantarao Vellaturi
· 4,949 Views · 4 Likes
article thumbnail
Understanding WebRTC Security Architecture and IoT
Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.
January 8, 2025
by Carsten Rhod Gregersen
· 7,022 Views · 1 Like
article thumbnail
Data Governance Challenges in the Age of Generative AI
Navigate privacy, security, and compliance challenges for innovation. Effective data governance is now more critical due to recent generative AI developments.
January 7, 2025
by nishchai jayanna manjula
· 6,993 Views · 3 Likes
article thumbnail
The Evolution of Adaptive Frameworks
Adaptive frameworks revolutionize collaboration by providing real-time, personalized updates that address traditional tool limitations.
January 6, 2025
by Manasi Sharma
· 3,914 Views · 2 Likes
article thumbnail
Efficiently Processing Billions of Rows Daily With Presto
In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.
January 6, 2025
by Ajay Krishnan Prabhakaran
· 5,502 Views · 3 Likes
article thumbnail
Setting Up Local Kafka Container for Spring Boot Application
Set up Kafka container for Spring Boot application, which covers container configuration, Docker Desktop, and Spring Boot integration.
January 6, 2025
by Amol Gote DZone Core CORE
· 6,601 Views · 4 Likes
article thumbnail
Event-Driven AI: Building a Research Assistant With Kafka and Flink
Learn about the development of an AI-powered research assistant created to help prepare for podcast interviews.
January 6, 2025
by Sean Falconer
· 3,538 Views · 3 Likes
article thumbnail
Incremental Jobs and Data Quality Are On a Collision Course
Big data isn’t dead; it’s just going incremental. But bad things happen when uncontrolled changes collide with incremental jobs. Reacting to changes is a losing strategy.
January 1, 2025
by Jack Vanlightly
· 6,022 Views · 1 Like
article thumbnail
Streamlining Database Management: Running PostgreSQL in Docker Containers
You will learn how to run PostgreSQL in a Docker container with a portable, isolated, and resource-efficient database setup that is easy to manage and scalable.
December 31, 2024
by VARUNREDDY DEVIREDDY
· 6,981 Views · 3 Likes
article thumbnail
Iceberg Catalogs: A Guide for Data Engineers
Learn about Apache Iceberg catalogs, their types, configurations, and the best-fit solutions for managing metadata and large datasets in different environments.
December 31, 2024
by Naresh Dulam
· 6,974 Views · 2 Likes
article thumbnail
Bridging the Gap: Unlocking the Power of HDFS-Based Data Lakes With Streaming Databases
Big data technologies' quick development has highlighted the necessity of a smooth transition between real-time data analytics and batch processing systems.
December 30, 2024
by Gautam Goswami DZone Core CORE
· 3,166 Views · 1 Like
article thumbnail
The Future of Data Lies in Transformer Models vs. Big Data Transformations
Last year witnessed the explosive rise of large models, generating global enthusiasm and making AI seem like a solution to all problems.
December 25, 2024
by William Guo
· 5,413 Views · 1 Like
article thumbnail
Creating Scalable, Compliant Cloud Data Pipelines in SaaS through AI Integration
Cloud-based AI data pipelines provide SaaS companies with scalable, cost-effective solutions for real-time insights and efficient data management.
December 24, 2024
by Venkata Gummadi
· 23,986 Views · 3 Likes
article thumbnail
Key Considerations for On-Premise to Cloud Data Warehouse Migration
Migrating your on-premise data warehouse to the cloud requires thorough planning. This article will help in the decision-making process by addressing critical factors.
December 18, 2024
by Maria Anurag Reddy Basani
· 6,309 Views
article thumbnail
Delta Live Tables in Databricks: A Guide to Smarter, Faster Data Pipelines
Delta Live Tables (DLT) in Databricks streamlines data pipelines, enhancing data quality, simplifying pipeline management, and enabling real-time data processing.
December 18, 2024
by Kiran Polimetla
· 9,035 Views · 2 Likes
article thumbnail
How to Optimize Edge Devices for AI Processing
Desiging for edge AI is crucial in today's world with on-device processing and AI applications increasing in popularity.
December 17, 2024
by Emily Newton
· 5,281 Views · 1 Like
article thumbnail
Implementing OneLake With Medallion Architecture in Microsoft Fabric
This guide to Microsoft OneLake covers structured layers and security, enabling high-quality data optimization for analytics.
December 17, 2024
by Aravind Nuthalapati DZone Core CORE
· 25,556 Views · 3 Likes
article thumbnail
Databricks 101: An Introductory Guide on Navigating and Optimizing This Data Powerhouse
Learn about the pivotal role of Databricks Workflows and the nuanced world of compute resources.
December 12, 2024
by Noa Shavit
· 5,668 Views · 1 Like
article thumbnail
Data Processing With Python: Choosing Between MPI and Spark
Know the differences between MPI and Spark for big data processing and find out which framework suits your needs for parallel and distributed computing.
December 11, 2024
by Anil Kumar Moka
· 18,292 Views
article thumbnail
Leveraging Golang for Modern ETL Pipelines
Golang enhances ETL pipelines with real-time processing, efficient concurrency, low latency, and minimal resource usage for handling large data.
December 9, 2024
by Vivek Kumar
· 16,812 Views
  • Previous
  • ...
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×