Big Data Resources

Using Jolt in Big Data Streams to Remove Nulls

Learn how to use Jolt code within your big data streams to remove null values with some example source data and JSON code.

December 9, 2017

by Tim Spann

CORE

· 11,655 Views · 3 Likes

Apache Kafka: How to Load Test With JMeter

In today's post, we take a look at how you can load test your Apache Kafka setup using JMeter. Read on for more details.

December 7, 2017

by Roman Aladev

· 21,321 Views · 8 Likes

2017 DevOps Surprises

You never know what the year will bring in development, like DevOps and Cloud's strong positive correlation that begets containers and microservices.

December 7, 2017

by Tom Smith

CORE

· 9,122 Views · 3 Likes

Sensor Data Quality Management Using PySpark and Seaborn

Learn how to check data for required values, validate data types, and detect integrity violation using data quality management (DQM).

December 2, 2017

by Rathnadevi Manivannan

· 11,146 Views · 5 Likes

AI and Machine Learning Trends for 2018: What to Expect

Now is the time to take a look at the most possible and promising machine learning and AI trends for the upcoming year and ask ourselves if we are ready for them.

December 1, 2017

by Dmitry Budko

· 51,735 Views · 15 Likes

Exploratory and Confirmatory Analysis: What's the Difference?

Learn about the differences and uses of exploratory data analysis and confirmatory analysis by considering the process a detective goes through.

November 29, 2017

by Shelby Blitz

· 18,446 Views · 1 Like

Quick Start With Apache Livy

Learn how to get started with Apache Livy, a project in the process of being incubated by Apache that interacts with Apache Spark through a REST interface.

November 28, 2017

by Guglielmo Iozzia

· 47,528 Views · 7 Likes

AWS IoT: Retrieving SQS Messages From a Queue

Let's set up an AWS IoT Rule to call an AWS Lambda function triggered by MQTT messages. See how it's configured with this step-by-step guides.

November 27, 2017

by Kevin Hooke

· 8,393 Views · 4 Likes

Spring Boot Plus Apache Ignite Data Grid

Learn how to integrate Spring Boot with Apache Ignite to use Ignite's persistent durable memory feature and execute SQL queries over Ignite caches.

November 26, 2017

by Mahmoud Romeh

· 33,482 Views · 9 Likes

ETL Pipeline to Analyze Healthcare Data With Spark SQL, JSON, and MapR-DB

Learn how to ETL Open Payments CSV file data to JSON, explore with SQL, and store in a document database using Spark Datasets and MapR-DB.

November 23, 2017

by Carol McDonald

· 16,822 Views · 7 Likes

A Developer’s Introduction to the Pulsar Streaming Messaging System

Apache Pulsar is an open-source distributed pub-sub messaging system that's currently undergoing incubation. Get introduced to it here!

November 20, 2017

by Matteo Merli

· 13,635 Views · 7 Likes

Apache Spark Word Count: Data Analytics With a Publicly Available Dataset

Let's take things up a notch and check out how quickly we can get some huge datasets to perform word counts on the Yelp dataset.

November 17, 2017

by Kevin Hooke

· 19,227 Views · 4 Likes

Introduction to Apache Kafka [Tutorial]

What is Apache Kafka, and what can is be used for? Dive deep into what Apache Kafka is all about and learn how to create a Kafka cluster with three brokers.

November 17, 2017

by Siva Prasad Rao Janapati

· 62,851 Views · 22 Likes

Data Manipulation in R Using dplyr

Learn about the primary functions of the dplyr package and the power of this package to transform and manipulate your datasets with ease in R.

November 15, 2017

by Sibanjan Das

CORE

· 9,790 Views · 5 Likes

In-Memory Data Grid With Apache Ignite

Take a look at how to create an application that makes use of Apache Ignite, a new platform that is rapidly gaining popularity.

November 15, 2017

by Piotr Mińkowski

· 15,552 Views · 5 Likes

Connecting Message Queuing System With Mule ESB [Video]

In this series of videos, you'll learn how to connect various message queuing systems, like ActiveMQ and Kafka, with Mule ESB.

November 12, 2017

by Jitendra Bafna

CORE

· 8,576 Views · 3 Likes

Elevators: An IoT-Enabled Success Story

Settle in to hear the story of a Dutch company that transformed manual elevator logging into a digital industry standard and opened the door for predictive maintenance.

Updated November 9, 2017

by Danielle Goodman

· 8,814 Views · 2 Likes

IoT Glossary: 55 Terms You Need to Know

Beacons, communications protocols, edge gateways, integrators and more, if you develop IoT solutions, here are the essential phrases for your hobby or career.

November 9, 2017

by Mike Gates

· 20,203 Views · 4 Likes

NGINX and IoT: Adding Protocol Awareness for MQTT

Buckle up for a 30-minute talk about the current state of IoT data and a demo that tackles MQTT, TLS, load balancing, session persistence, and plenty more.

Updated November 8, 2017

by Liam Crilly

· 15,730 Views · 4 Likes

Feature Hashing for Scalable Machine Learning

Feature hashing is a valuable tool in the data scientist's arsenal. Learn how to use it as a fast, efficient, flexible technique for feature extraction that can scale to sparse, high-dimensional data.

November 8, 2017

by Nick Pentreath

· 18,016 Views · 3 Likes

The Latest Big Data Topics