Big Data Resources

How Is Facebook Deploying Big Data?

How Facebook harnessed Big Data by mastering open source tools, and in some cases developing their own.

Updated February 6, 2017

by Shravani Chakraborty

· 32,250 Views · 7 Likes

How Data Lakes Work

How data lakes can help eliminate costs and time involved in working with large amounts of data.

January 31, 2017

by Ben Sharma

· 12,140 Views · 7 Likes

Prediction Zone: Using R With Shiny

Sibanjan Das offers up a tutorial for building a web-based cluster and prediction analysis application through using R with the open source Shiny framework. Oh yeah, and he embedded the app directly into this DZone article... shine on you crazy data scientist.

January 30, 2017

by Sibanjan Das

· 19,686 Views · 9 Likes

A Framework for Chatbot Evaluation

Chatbots continue to work their way into ever-more solutions, but how should we evaluate their effectiveness? In this post we take a look at a potential framework for doing just that.

January 27, 2017

by Tony Russell-rose

· 8,061 Views

Scheduling Statistics Maintenance in Azure SQL Data Warehouse

You can leverage your Azure SQL Data Warehouse to automate some of your maintenance. Creating a Runbook will let you schedule to your hearts content.

January 23, 2017

by Grant Fritchey

· 4,441 Views · 2 Likes

Running Microservices on Top of In-Memory Data Grid: Part II

Let's look into the Apache Ignite Cluster Layer, a GitHub project that includes the basic building blocks needed to implement a proposed microservices-based architecture.

January 18, 2017

by Denis Magda

CORE

· 12,789 Views · 7 Likes

The First Steps to Analyzing Data in R

What steps should be taken when you want to analyze a data set in R? Enjoy these first steps to prepare your data for a variety of use cases.

January 17, 2017

by Sibanjan Das

· 21,382 Views · 8 Likes

The Battle of the Crawlers: Apache Nutch vs. StormCrawler

This post has everything you need to know about the efficiency of Apache Nutch and StormCrawler. Read on to find out more on the benchmark analysis and conclusion drawn from the study.

January 10, 2017

by Julien Nioche

· 23,636 Views · 2 Likes

Learning Lessons From the Zenith Space Phone: An Early Example of IoT?

A look back at the tech of the 1980s reveals an important lesson: Just because you can connect devices doesn't mean you should. That has implications for IoT.

January 10, 2017

by John Vester

CORE

· 23,897 Views · 1 Like

Validating Data in the Data Lake

How do you design your data lake architecture and what functionality do you need to validate the data in your data lake? Learn about it right now!

Updated January 9, 2017

by Tony Fisher

· 8,474 Views · 4 Likes

Build Your Own Digital Piano

If you want to jam on a piano but don't have a keyboard, don't worry, you can make one yourself. This guide uses a NodeMcu and Ubidots to bring a piano to life.

January 9, 2017

by Maria Hernandez

· 8,002 Views · 2 Likes

Kafka Avro Scala Example

Learn how to write and read messages in Avro format to/from Kafka. Read on to understand how to produce messages encoded with Avro, how to send them into Kafka, and how to consume with consumer and finally how to decode them.

January 6, 2017

by Sushil Kumar Singh

· 424,406 Views · 11 Likes

Using Kafka With JUnit

The Spring Kafka project provides a way to use Kafka in tests by providing an embedded version of Kafka that is easily set up and torn down.

January 2, 2017

by Biju Kunjummen

· 52,117 Views · 3 Likes

13 Software Failures of 2016 That Testing Could Have Prevented

As businesses continue to migrate to digital platforms, it becomes absolutely critical to conduct rigorous software testing before the launching of a product.

January 2, 2017

by Hiren Tanna

· 28,093 Views · 2 Likes

Triggering Lambda Functions With an AWS IoT Button

It turns out that it's easy to merge serverless architecture with your IoT projects by having AWS IoT Button trigger an AWS Lambda function.

December 31, 2016

by Arun Gupta

· 14,147 Views · 4 Likes

ETL vs Pure SQL

Which one will come out on top? You should definitely check out the results so you can decide which one to use for your next project.

December 30, 2016

by Mateusz Komendołowicz

· 7,222 Views · 5 Likes

Using Apache POI to Convert Excel to an Elasticsearch Compatible JSON

Let's see what happens when you upload data into an Elasticsearch index and learn why Logstash was not the answer.

December 29, 2016

by Bipin Patwardhan

· 8,497 Views · 1 Like

Bulk Indexing With ElasticSearch

If your case requires a lot of document indexing, then extensive care should be taken to speed up the process. bulkIndex can help.

December 28, 2016

by Cagatay Gokcel

· 31,450 Views · 9 Likes

Monitoring OpenStack With the ELK Stack

Elasticsearch, Logstash, and Kibana (ELK) form an open source stack that has become a a leading log analysis platform to monitor, in this case, OpenStack.

December 25, 2016

by Asaf Yigal

· 12,077 Views · 6 Likes

Configuring Memory for MapReduce Running on YARN

There are times when a MapReduce job exceeds its memory limits. This article presents an overview of how YARN monitors the memory for containers and provides the technique to fix this issue.

December 23, 2016

by Alex Holmes

· 62,577 Views · 2 Likes

The Latest Big Data Topics