Big Data Resources

How to Install the ELK Stack on Google Cloud Platform

In this article, I will guide you through the process of installing the ELK Stack (Elasticsearch 2.2.x, Logstash 2.2.x and Kibana 4.4.x) on Google Cloud Platform (GCP).

August 18, 2016

by Daniel Berman

· 9,998 Views · 1 Like

CloudFront Log Analysis Using the Logz.io ELK Stack

This article covers using ElasticSearch+LogStash+Kibana (ELK) as a service for working.

August 17, 2016

by Daniel Berman

· 6,006 Views · 2 Likes

Securing Apache Spark Shuffle Using Apache Commons Crypto

Learn how the performance advantages of the Crypto cryptographic library will provide an upgrade for Spark shuffle encryption over the current approach.

August 11, 2016

by Cheng Xu

· 6,306 Views · 3 Likes

Indoor Location Services: Introduction to IoT Networking

While many IoT posts focus on developing the things, this post focuses on the network that's connecting the things. But beyond the network, we'll also talk about the APIs involved. In this post, I'll specifically show you how to go about setting up blue dot functionality for indoor location services.

July 29, 2016

by Chris Oggerino

· 7,451 Views · 9 Likes

Hadoop: DataNode Not Starting

Running Hadoop and having problems with your DataNode? Read on to find out one possible solution.

July 26, 2016

by Mark Needham

· 22,991 Views · 1 Like

Is Java Dead? No! Here’s Why...

We see this “Is Java dead?” question pop up year after year, and yet, by all external markers, Java is alive, well, and growing. Read on for more info!

July 18, 2016

by Lindsay Brunner

· 32,268 Views · 36 Likes

How the Internet of Things Helps Water Management

Learn about how the Internet of Things is affecting water management, from smart irrigation to water consumption in a city.

July 15, 2016

by Yash Mehta

· 15,784 Views · 3 Likes

Microservices With AngularJS, Spring Boot, and Kafka

Asynchronous end-to-end calls starting from the view layer to the backend is important in a microservices architecture because there is no guarantee that the containers which receive the calls will handle the response.

Updated July 13, 2016

by Ayman Elgharabawy

· 106,125 Views · 50 Likes

Connected Healthcare: Internet of Things Examples in Health Care

Yash Mehta from IoT Worm shares examples of the impact of IoT in the healthcare industry, from the ability to home monitor patients to enhanced drug management.

July 13, 2016

by Yash Mehta

· 29,778 Views · 5 Likes

How to Use Xively Platform in an IoT Project

This tutorial explores how to use Xively and how to connect a “smart object” to Xively platform.

July 4, 2016

by Francesco Azzola

· 19,592 Views · 2 Likes

Meet Kapua: An Open Source End-to-End IoT Cloud Platform

Red Hat, Eclipse, and Eurotech have announced Eclipse Kapua — an end-to-end open source IOT cloud platform that combines and enhances several current solutions.

July 1, 2016

by Mike Gates

· 16,284 Views · 6 Likes

Implementing Hadoop's Input and Output Format in Spark

A detailed tutorial on how to use Apache Spark to implement Hadoop input and output formats.

June 17, 2016

by VIKALP JAIN

· 40,517 Views · 5 Likes

Don't Go Into ElasticSearch Production Without This Checklist

Some great tips to keep in mind when embarking on your ElasticSearch journey.

June 16, 2016

by Darren Perucci

· 5,759 Views · 2 Likes

From POSIX to AWS and S3

Learn how storage evolved from the prototypical hierarchical method of old to the seemingly limitless systems of AWS' S3 system.

June 12, 2016

by Brad King

· 5,434 Views · 3 Likes

Elasticsearch Throttling Indexing

If segment merging falls behind indexing, Elasticsearch will throttle indexing requests to a single thread.

June 10, 2016

by James Carr

· 11,695 Views · 2 Likes

Microservices Granularity for the Internet of Things

There are a lot of parallels between the Internet Of Things and Microservices. One of the big battles in the design is the granularity of each service and the impact that can have on interdependency and network costs.

June 2, 2016

by Scott Lewis

· 4,945 Views · 1 Like

Big Data in Oil and Gas IIoT

With a modern IIoT and cloud platform underlying the next generation of applications and analytics, the oil and gas industry can move beyond just doing the same thing faster or cheaper and adopt new levels of productivity.

June 2, 2016

by Dan Miklovic

· 5,627 Views · 4 Likes

In this post, learn about how to integrate synchronous and asynchronous systems via Kafka's publish-subscribe mechanism.

May 27, 2016

by Felipe Fernández

· 20,216 Views · 4 Likes

The Many Flavors of Ops

Once upon at time, there was just IT. Now everything is an Ops-filled buzzword soup (SoupOps!), but believe it or not, they all have their place.

May 27, 2016

by Fredric Paul

· 5,484 Views · 2 Likes

A Brief History of Apache Storm

Storm started as an idea to bring the power of Hadoop to real-time data, and has only grown since then.

May 25, 2016

by Taylor Goetz

· 7,207 Views · 7 Likes

The Latest Big Data Topics