Big Data Resources

HBase Compaction and Data Locality With Hadoop

Compaction is a process by which HBase cleans itself, and data locality is a solution to data not being available to Mapper.

March 2, 2017

by Jitendra Bafna

· 31,113 Views · 5 Likes

Data Modelling Topologies of a Graph Database

The associative data graph database model is still a heavy hitter, stacking up well against property graphs and triples/quadruples. Expect a comeback.

March 1, 2017

by Athanassios I. Hatzis, PhD

· 13,480 Views · 9 Likes

Big Data Solves Real-World Problems

Working smartly with Big Data results in improved customer and patient experiences across a variety of different industries.

February 24, 2017

by Tom Smith

CORE

· 10,896 Views · 3 Likes

Getting Started With Apache Camel and the Internet of Things

If you're planning to invest in connected devices, make sure your middleware and communications are up to snuff. In this case, we look a how to mix Camel with a Pi.

February 20, 2017

by Joseph S. Butler

· 9,108 Views · 10 Likes

A Disk-Based Collection in Java

Feeling constrained by your heap? Want to store more elements in a collection than your memory can hold? Check out this project designed to handle big collections.

February 17, 2017

by Reinout Korbee

· 24,138 Views · 6 Likes

A Look at ClickHouse: A New Open Source Columnar Database

ClickHouse is an open source columnar database that promises fast scans that can be used for real-time queries. See how it works, complete with benchmarks against Spark.

Updated February 17, 2017

by Alexander Rubin

· 19,318 Views · 1 Like

5 Data Storage Solutions for Better Log Management

Depending on how much data you have from saving time-based events, you may want to choose one storage solution over the other.

February 16, 2017

by Vladislav Chernov

· 96,743 Views · 5 Likes

Introducing the Thingsboard Open Source IoT Gateway

Thingsboard is hard at work on a new open source gateway that should allow devs from hobbyists to IIoT specialists to connect to devices regardless of protocol.

February 12, 2017

by Andrew Shvayka

· 16,675 Views · 7 Likes

CART and Random Forests for Practitioners

Both CART and Random Forests help data scientists better understand algorithms and work with dirty data. However, they still have some key differences.

February 10, 2017

by Sibanjan Das

· 16,563 Views · 4 Likes

TensorFlow on the Edge, Part 1 of 5

Running TensorFlow on the Edge is now possible, what, why and how?

February 6, 2017

by Tim Spann

CORE

· 19,756 Views · 6 Likes

How Is Facebook Deploying Big Data?

How Facebook harnessed Big Data by mastering open source tools, and in some cases developing their own.

Updated February 6, 2017

by Shravani Chakraborty

· 32,281 Views · 7 Likes

How Data Lakes Work

How data lakes can help eliminate costs and time involved in working with large amounts of data.

January 31, 2017

by Ben Sharma

· 12,191 Views · 7 Likes

Prediction Zone: Using R With Shiny

Sibanjan Das offers up a tutorial for building a web-based cluster and prediction analysis application through using R with the open source Shiny framework. Oh yeah, and he embedded the app directly into this DZone article... shine on you crazy data scientist.

January 30, 2017

by Sibanjan Das

· 19,703 Views · 9 Likes

A Framework for Chatbot Evaluation

Chatbots continue to work their way into ever-more solutions, but how should we evaluate their effectiveness? In this post we take a look at a potential framework for doing just that.

January 27, 2017

by Tony Russell-rose

· 8,087 Views

Scheduling Statistics Maintenance in Azure SQL Data Warehouse

You can leverage your Azure SQL Data Warehouse to automate some of your maintenance. Creating a Runbook will let you schedule to your hearts content.

January 23, 2017

by Grant Fritchey

· 4,458 Views · 2 Likes

Running Microservices on Top of In-Memory Data Grid: Part II

Let's look into the Apache Ignite Cluster Layer, a GitHub project that includes the basic building blocks needed to implement a proposed microservices-based architecture.

January 18, 2017

by Denis Magda

CORE

· 12,823 Views · 7 Likes

The First Steps to Analyzing Data in R

What steps should be taken when you want to analyze a data set in R? Enjoy these first steps to prepare your data for a variety of use cases.

January 17, 2017

by Sibanjan Das

· 21,427 Views · 8 Likes

The Battle of the Crawlers: Apache Nutch vs. StormCrawler

This post has everything you need to know about the efficiency of Apache Nutch and StormCrawler. Read on to find out more on the benchmark analysis and conclusion drawn from the study.

January 10, 2017

by Julien Nioche

· 23,692 Views · 2 Likes

Learning Lessons From the Zenith Space Phone: An Early Example of IoT?

A look back at the tech of the 1980s reveals an important lesson: Just because you can connect devices doesn't mean you should. That has implications for IoT.

January 10, 2017

by John Vester

CORE

· 23,960 Views · 1 Like

Validating Data in the Data Lake

How do you design your data lake architecture and what functionality do you need to validate the data in your data lake? Learn about it right now!

Updated January 9, 2017

by Tony Fisher

· 8,490 Views · 4 Likes

The Latest Big Data Topics