Big Data Resources

Kafka Producer Delivery Semantics

We take a deep dive into the various delivery semantics available for use in Apache Kafka.

Updated May 16, 2019

by Sylvester Daniel

· 29,356 Views · 9 Likes

Streaming ML Pipeline for Sentiment Analysis Using Apache APIs: Kafka, Spark, and Drill (Part 1)

In this first part, we will explore sentiment analysis using Spark machine learning data pipelines.

Updated May 16, 2019

by Carol McDonald

· 28,059 Views · 19 Likes

Blockchain Vs Tangle: Which Is Better?

Let's look at different cryptocurrency platforms and which is the best.

Updated May 10, 2019

by John Ryan

· 21,297 Views · 5 Likes

Protocols and Standards Behind IoT: CoAP, BLE, MQTT, DDS

Here's your guide to IoT protocols and standards.

May 9, 2019

by Martin Lewis

· 15,012 Views · 4 Likes

Introduction to Message Brokers. Part 1: Apache Kafka vs. RabbitMQ

If you're looking for a message broker for your next project, read on to get an overview of to of the most popular open source solutions out there.

May 8, 2019

by Vitaliy Samofal

· 42,671 Views · 30 Likes

Kafka Producer Overview

In this post, we take a look in to producers in Apache Kafka and what they allow devs and data scientists to do.

Updated May 7, 2019

by Sylvester Daniel

· 20,516 Views · 12 Likes

Kafka Technical Overview

In this post, we take a high-level look at the architecture of Apache Kafka, the role ZooKeeper plays, and more.

Updated May 7, 2019

by Sylvester Daniel

· 36,009 Views · 51 Likes

How to Build a Data Pipeline Using Kafka, Spark, and Hive

In this post, we learn how to make a basic data pipeline using these popular Apache frameworks and the Scala language.

May 7, 2019

by Avi Garg

· 31,260 Views · 5 Likes

A Complete Tutorial on the Drools Business Rule Engine

Check out this post for a complete guide to the Drools business rule engine.

May 2, 2019

by Federico Tomassetti

· 23,964 Views · 3 Likes

Optimizing Kafka Streams Applications

Let's see how to optimize Kafka Streams applications.

May 2, 2019

by Bill Bejeck

· 20,204 Views · 5 Likes

Build and Install Hadoop on Windows With Native Binaries

Build your own Hadoop distribution in order to make it run on Windows 7 with this in-depth tutorial.

Updated May 1, 2019

by Gopal Tiwari

· 50,958 Views · 11 Likes

Assessing Cloud Backup Solutions: AWS vs. Azure vs. Google Cloud

Take a look at what each of the three leading cloud vendors has to offer for backup and data storage.

May 1, 2019

by Gilad David Maayan

· 16,025 Views · 2 Likes

Measure document similarity automatically and query them efficiently.

May 1, 2019

by Sibanjan Das

· 7,397 Views · 4 Likes

How to Protect IoT Applications With Role-Based Access Control (RBAC)

Learn more about role-based access control for IoT applications.

Updated April 29, 2019

by Mike Mackrory

· 7,428 Views · 1 Like

Kafka Internals: Consumers

In this post, we continue our look under the hood of Apache Kafka by exploring how consumers work in this platform.

April 25, 2019

by Arun Lingala

· 40,597 Views · 11 Likes

Example of ETL Application Using Apache Spark and Hive

In this article, we'll read a sample data set with Spark on HDFS (Hadoop File System), do a simple analytical operation, then write to a table that we'll make in Hive.

April 24, 2019

by Emrah Mete

· 38,126 Views · 4 Likes

Kafka Internals: Topics and Partitions

We take a look under the hood of Apache Kafka to better understand how this popular framework uses topics and partitions.

April 24, 2019

by Arun Lingala

· 33,905 Views · 13 Likes

Streaming IoT Data and MQTT Messages to Apache Kafka

Use Apache Kafka for all your IoT data streaming and MQTT message needs!

April 24, 2019

by Ian Skerrett

· 23,317 Views · 13 Likes

How to Process Nasty Fixed Width Files Using Apache Spark

Fixed width files can be a pain. Learn how to get around the issues they present using Scala and Spark.

April 19, 2019

by Subhasish Guha

· 30,469 Views · 6 Likes

Introduction to Elasticsearch and the ELK Stack, Part 1

In this post, we cover the frameworks that make up the ELK stack (Elasticsearch, Logstash, Kibana [plus Beats]) and how they all work together.

Updated April 18, 2019

by Ayush Jain

· 20,550 Views · 9 Likes

The Latest Big Data Topics