Big Data Resources

Streaming ML Pipeline for Sentiment Analysis Using Apache APIs: Kafka, Spark, and Drill (Part 1)

In this first part, we will explore sentiment analysis using Spark machine learning data pipelines.

Updated May 16, 2019

by Carol McDonald

· 27,457 Views · 19 Likes

Blockchain Vs Tangle: Which Is Better?

Let's look at different cryptocurrency platforms and which is the best.

Updated May 10, 2019

by John Ryan

· 20,378 Views · 5 Likes

Protocols and Standards Behind IoT: CoAP, BLE, MQTT, DDS

Here's your guide to IoT protocols and standards.

May 9, 2019

by Martin Lewis

· 14,258 Views · 4 Likes

Introduction to Message Brokers. Part 1: Apache Kafka vs. RabbitMQ

If you're looking for a message broker for your next project, read on to get an overview of to of the most popular open source solutions out there.

May 8, 2019

by Vitaliy Samofal

· 41,216 Views · 30 Likes

Kafka Producer Overview

In this post, we take a look in to producers in Apache Kafka and what they allow devs and data scientists to do.

Updated May 7, 2019

by Sylvester Daniel

· 19,687 Views · 12 Likes

Kafka Technical Overview

In this post, we take a high-level look at the architecture of Apache Kafka, the role ZooKeeper plays, and more.

Updated May 7, 2019

by Sylvester Daniel

· 35,113 Views · 51 Likes

How to Build a Data Pipeline Using Kafka, Spark, and Hive

In this post, we learn how to make a basic data pipeline using these popular Apache frameworks and the Scala language.

May 7, 2019

by Avi Garg

· 30,230 Views · 5 Likes

A Complete Tutorial on the Drools Business Rule Engine

Check out this post for a complete guide to the Drools business rule engine.

May 2, 2019

by Federico Tomassetti

· 22,927 Views · 3 Likes

Optimizing Kafka Streams Applications

Let's see how to optimize Kafka Streams applications.

May 2, 2019

by Bill Bejeck

· 19,496 Views · 5 Likes

Build and Install Hadoop on Windows With Native Binaries

Build your own Hadoop distribution in order to make it run on Windows 7 with this in-depth tutorial.

Updated May 1, 2019

by Gopal Tiwari

· 49,202 Views · 11 Likes

Assessing Cloud Backup Solutions: AWS vs. Azure vs. Google Cloud

Take a look at what each of the three leading cloud vendors has to offer for backup and data storage.

May 1, 2019

by Gilad David Maayan

CORE

· 14,196 Views · 2 Likes

Measure document similarity automatically and query them efficiently.

May 1, 2019

by Sibanjan Das

CORE

· 6,769 Views · 4 Likes

How to Protect IoT Applications With Role-Based Access Control (RBAC)

Learn more about role-based access control for IoT applications.

Updated April 29, 2019

by Mike Mackrory

· 6,984 Views · 1 Like

Kafka Internals: Consumers

In this post, we continue our look under the hood of Apache Kafka by exploring how consumers work in this platform.

April 25, 2019

by Arun Lingala

· 39,723 Views · 11 Likes

Example of ETL Application Using Apache Spark and Hive

In this article, we'll read a sample data set with Spark on HDFS (Hadoop File System), do a simple analytical operation, then write to a table that we'll make in Hive.

April 24, 2019

by Emrah Mete

· 36,590 Views · 4 Likes

Kafka Internals: Topics and Partitions

We take a look under the hood of Apache Kafka to better understand how this popular framework uses topics and partitions.

April 24, 2019

by Arun Lingala

· 32,869 Views · 13 Likes

Streaming IoT Data and MQTT Messages to Apache Kafka

Use Apache Kafka for all your IoT data streaming and MQTT message needs!

April 24, 2019

by Ian Skerrett

· 22,148 Views · 13 Likes

How to Process Nasty Fixed Width Files Using Apache Spark

Fixed width files can be a pain. Learn how to get around the issues they present using Scala and Spark.

April 19, 2019

by Subhasish Guha

· 29,571 Views · 6 Likes

Introduction to Elasticsearch and the ELK Stack, Part 1

In this post, we cover the frameworks that make up the ELK stack (Elasticsearch, Logstash, Kibana [plus Beats]) and how they all work together.

Updated April 18, 2019

by Ayush Jain

· 19,351 Views · 9 Likes

10 Best JavaScript Charting Libraries for Any Data Visualization Need

If you're interested in learning how to visualize your findings, read on for a list of great data viz libraries to help get you started.

April 18, 2019

by Ruslan Borovikov

· 39,552 Views · 15 Likes

The Latest Big Data Topics