DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Big Data Topics

article thumbnail
Building Threat Intelligence Pipelines Using Python, APIs, and Elasticsearch
STIX/TAXII in, ECS normalized, provenance preserved deterministic IDs, correct bulk writes, ingest pipelines keep threat indicator data reliable and queryable under load.
June 3, 2026
by Krishnaveni Musku
· 3,179 Views
article thumbnail
Optimizing Databricks Spark Pipelines Using Declarative Patterns
This article explains why hand-tuning Spark is becoming the slow path — and what the declarative alternatives actually look like in production.
June 1, 2026
by Seshendranath Balla Venkata
· 1,444 Views · 1 Like
article thumbnail
Event-Driven Pipelines With Apache Pulsar and Go
Build scalable, real-time pipelines with Apache Pulsar and Go using event-driven producers and consumers that communicate via Pulsar topics.
May 29, 2026
by Shivi Kashyap
· 3,049 Views
article thumbnail
Contract-First Integration: Building Scalable Systems With Flyway, OpenAPI, and Kafka
Define API, event, and DB contracts upfront to enable parallel development, catch breaking changes in CI, and maintain consistent, reliable integrations.
May 29, 2026
by Wallace Espindola
· 2,734 Views
article thumbnail
Building a Zero-Cost Approval Workflow With AWS Lambda Durable Functions
Learn how to build an ETL pipeline with human-in-the-loop approval that costs nothing while waiting — and see real cost data from processing 1,000 documents.
May 28, 2026
by Harpreet Siddhu
· 4,573 Views · 1 Like
article thumbnail
Kafka and Spark Structured Streaming in Enterprise: The Patterns That Hold Up Under Pressure
The streaming patterns that survive in the enterprise are those built for scale, failure recovery, and long-term operability.
May 27, 2026
by Kuladeep Sandra
· 6,842 Views
article thumbnail
Exactly-Once Processing: Myth vs Reality
Exactly-once is a collection of local guarantees, not an end-to-end guarantee, and real systems rely on idempotency and at-least-once guarantees.
May 26, 2026
by Irullappan irulandi
· 2,790 Views · 2 Likes
article thumbnail
Building Enterprise-Grade Real-Time IoT Dashboards with Vue 3, MQTT, and Kafka
Event-driven architecture using MQTT (device communication) → Kafka (durable streams) → WebSocket (browser push) → Vue 3 (reactive UI).
May 26, 2026
by Venkata Sandeep Dhullipalla
· 2,356 Views
article thumbnail
Edge Computing in Utility IoT: Two Architecture Patterns That Actually Work
In this article, we break down edge architecture patterns that fit modern utility infrastructure when power flows both ways.
May 22, 2026
by Yevheniia Mala
· 4,130 Views
article thumbnail
Why We Chose Iceberg Over Delta After Evaluating Both at Scale
Delta often performs better for Spark workloads, while Iceberg tends to be stronger for a multi-engine environment. The right choice depends on your platform use case.
May 21, 2026
by Kuladeep Sandra
· 2,517 Views
article thumbnail
Architecting Petabyte-Scale Hyperspectral Pipelines on AWS
Learn how to overcome serverless bottlenecks to process and route petabyte-scale hyperspectral agricultural data on AWS.
May 21, 2026
by Anil Bodepudi
· 3,651 Views
article thumbnail
Mocking Kafka for Local Spring Development
When you don't need a real Kafka cluster yet, a lightweight substitute can remove a lot of friction. Use a portable mock environment and wire it into your app.
May 19, 2026
by Roman Dubinin
· 3,126 Views · 1 Like
article thumbnail
The Network Attach Problem Nobody Warns You About
NB-IoT, Cat-M, and now RedCap all surface the same mass attach problem at scale. Here's what it is, why RedCap doesn't escape it, and what to fix before activation day.
May 14, 2026
by SESHA KIRAN GONABOYINA
· 2,301 Views
article thumbnail
Content Lakes: Harness Unstructured Data for Enterprise AI Readiness
Harness unstructured data by transforming "dark data" into AI-ready assets through serverless orchestration and intelligent enrichment.
May 14, 2026
by Niranjan Yadavali
· 2,029 Views
article thumbnail
Ten Years of Beam: From Google's Dataflow Paper to 4 Trillion Events at LinkedIn
Apache Beam turns ten. From Google's 2015 Dataflow paper to 4 trillion daily events at LinkedIn — what it got right, where it falls short, and what comes next.
May 14, 2026
by Abgar Simonean
· 1,635 Views
article thumbnail
How AI Is Rewriting Full-Stack Java Systems: Practical Patterns with Spring Boot, Kafka and WebSockets
Decouple heavy processing with Spring Boot, Kafka, and WebSockets: AI consumers analyze events asynchronously, while WebSockets deliver real-time insights to users.
May 8, 2026
by Ramya vani Rayala
· 2,914 Views · 1 Like
article thumbnail
The Data Warehouse Concurrency Playbook: Surviving the "Super Bowl" Moment
Classify requests (dashboards vs exploration/jobs), cap and prioritize concurrency, and fall back to cache/rollups so critical dashboards stay responsive during spikes.
May 8, 2026
by Anusha Kovi DZone Core CORE
· 2,158 Views
article thumbnail
From Compliance Pipes to Data Streams: Modernizing Healthcare EDI for Strategic Value
The real cost of black-box EDI isn’t fees — it’s missed opportunities. Here’s how to turn healthcare data flow into a strategic asset.
May 7, 2026
by Naga Sai Mrunal Vuppala
· 2,264 Views
article thumbnail
Modernization Is Not Migration
CI/CD-driven modernization of data platforms, improving release speed, observability, and reliability through automation, parallelization, and job-level telemetry.
May 5, 2026
by vaibhav Sharma
· 1,956 Views
article thumbnail
Evolving Spring Boot APIs to an Event-Driven Mesh
Learn to transform Spring Boot REST APIs into an event-driven architecture by utilizing Kafka, RabbitMQ, or NATS to enhance scalability, resilience, and responsiveness.
May 5, 2026
by Lavi Kumar
· 1,684 Views · 1 Like
  • Previous
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×