DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Newsletter
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Big Data Topics

article thumbnail
An Overview of Data Pipeline Architecture
Dive into how a data pipeline helps process enormous amounts of data, key components, various architecture options, and best practices for maximum benefits.
Updated June 3, 2024
by Sreenath Devineni DZone Core CORE
· 17,470 Views · 5 Likes
article thumbnail
Profiling Big Datasets With Apache Spark and Deequ
Struggling to maintain large dataset quality or ensure reliable data attributes in your analyses? Integrating Deequ with Spark might be the solution you need.
May 29, 2024
by Akshay Jain
· 80,093 Views · 62 Likes
article thumbnail
Streamlining Data Warehouse Migrations From RedShift, Snowflake, and BigQuery to Apache Doris
Migrate Redshift, Snowflake, and BigQuery to Apache Doris for high-performance OLAP using tools like Apache Nifi, Talend, and Python.
May 28, 2024
by Sameer Danave
· 1,897 Views · 2 Likes
article thumbnail
Preventing and Fixing Bad Data in Event Streams (Part 1)
In this blog, we’ll take a look at how bad data may come to be, and how we can deal with it when it comes to event streams.
May 28, 2024
by Adam Bellemare
· 4,596 Views · 3 Likes
article thumbnail
ARM CPU for Cost-Effective Apache Kafka at the Edge and Cloud
Learn about ARM CPU for cost-effective and energy-efficient data streaming with Apache Kafka at the Edge and in the Cloud, including use cases.
May 27, 2024
by Kai Wähner DZone Core CORE
· 3,185 Views · 1 Like
article thumbnail
Bridging the Gap: Exploring Innovative Paths in Data Integration
This article solely focuses on delving into understanding data integrations, associated challenges, emerging technologies, and advanced methodologies.
May 27, 2024
by Yash Mehta
· 1,496 Views · 1 Like
article thumbnail
Apache Doris for Log and Time Series Data Analysis
NetEase has replaced Elasticsearch and InfluxDB with Apache Doris, achieving 11X query performance and saving 70% of resources.
May 25, 2024
by Shirley H.
· 2,292 Views · 1 Like
article thumbnail
Capturing Acknowledgement in Kafka Streaming With RecordMetadata
In this article, explore RecordMetadata, and its attributes, and discover how it can be leveraged using various use cases.
May 24, 2024
by Raja Chattopadhyay
· 4,506 Views · 2 Likes
article thumbnail
Useful Tips and Tricks for Data Scientists
In this article, I will share some of the tricks and tools that I am using to interpret the data in a fast and precise way and get useful insights from it.
May 22, 2024
by Pavel Perfilov
· 6,204 Views · 35 Likes
article thumbnail
Cost Optimization Strategies for High-Volume Data Platforms
Managing costs in running a Big Data Platform can be very challenging. This article talks through various strategies to optimize cost at every layer of the platform.
May 22, 2024
by Mayank Singhi
· 2,612 Views · 2 Likes
article thumbnail
A Beginner’s Guide to Snowflake Architecture
Snowflake is a cloud-based data warehousing solution that targets removing the nightmares associated with business data storage, management, and analytics.
May 22, 2024
by Saigurudatta Pamulaparthyvenkata
· 3,740 Views · 3 Likes
article thumbnail
Using Primary, Partition, and Clustering Keys in ScyllaDB (or Cassandra)
Learn core data modeling concepts that are critical for optimizing performance in wide-column NoSQL databases.
May 20, 2024
by Guy Shtub
· 2,732 Views · 1 Like
article thumbnail
10 Svelte Data Grids: Choose the Right One for Your Project
Explore these tips on how to choose the perfect data grid that can be seamlessly integrated into your next Svelte-based project.
May 20, 2024
by Alena Stasevich
· 6,588 Views · 3 Likes
article thumbnail
GenAI Demo With Kafka, Flink, LangChain and OpenAI
Explore the architecture and demo for open-source data streaming using Apache Kafka and Flink with Python, LangChain, and OpenAI LLM APIs in the cloud.
May 17, 2024
by Kai Wähner DZone Core CORE
· 3,720 Views · 1 Like
article thumbnail
Data Science: A Deep Dive Into Careers and Future Scope
Data science is a booming field with diverse career options. It involves analyzing data to uncover insights and requires both technical and soft skills.
May 16, 2024
by Manas Sadangi
· 3,253 Views · 1 Like
article thumbnail
Comparing Pandas, Polars, and PySpark: A Benchmark Analysis
Compare different datasets of three tools - Pandas, Polars, and PySpark - with a conclusion about where the future of data processing is going.
May 16, 2024
by Nacho Corcuera
· 11,155 Views · 2 Likes
article thumbnail
DevOps vs. DataOps vs. MLOps vs. AIOps: Comparison of All "Ops"
The acronym "Ops" has rapidly increased in IT operations in recent years. Explore different "Ops" in this explanation of DevOps, DataOps, MLOps, and AIOps.
May 16, 2024
by Ravi Kiran Mallidi DZone Core CORE
· 9,473 Views · 6 Likes
article thumbnail
10 ChatGPT Prompts To Boost Developer Productivity
In this article, we’ll explore 10 ChatGPT prompts tailored specifically for developers and engineers to boost their productivity and streamline their workflow.
May 15, 2024
by Shahid Shaikh
· 5,941 Views · 12 Likes
article thumbnail
The Beginner's Guide To Understanding Graph Databases
Explore how graph databases manage complex data through nodes and edges, uses in social networks, fraud detection, and advantages over relational databases.
May 14, 2024
by Shantanu Kumar DZone Core CORE
· 7,509 Views · 12 Likes
article thumbnail
Leveraging Apache Airflow on AWS EKS (Part 3): Advanced Topics and Practical Use Cases
In part three of this series, take an in-depth look at Apache Airflow, including advanced topics and practical use cases.
May 14, 2024
by Karthik Rajashekaran DZone Core CORE
· 2,335 Views · 2 Likes
  • Previous
  • ...
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×