Big Data Resources

An introduction to Spark Streaming and how to use it with an example data set.

April 10, 2016

by Carol McDonald

· 83,886 Views · 13 Likes

A Data Lake Architecture With Hadoop and Open Source Search Engines

"Big data" and "data lake" only have meaning to an organization’s vision when they solve business problems by enabling data democratization, re-use, exploration, and analytics. Read on to learn what a data lake is, its various benefits, and what's to come.

April 4, 2016

by Carlos Maroto

· 35,273 Views · 6 Likes

Spark Salesforce Connector Tutorial Using JDBC

We have a quick look at leveraging Apache Spark to access data in Salesforce via its JDBC connector. Come see how it's done!

April 1, 2016

by Nishanth Kadiyala

· 10,240 Views · 4 Likes

Word Count Programs: Spark vs. MapReduce

Why use Spark for big data processing? Compare these two word count program examples.

March 23, 2016

by Shiv Shet

· 25,746 Views · 6 Likes

A Beginner's Guide to Apache Kafka

A bare bones, bare necessities guide to what Apache Kafka can do and why it is popular.

March 23, 2016

by Shiv Shet

· 10,394 Views · 7 Likes

Comparison of Asynchronous Messaging Technologies: JMS, AMQP, and MQTT

A comparison of three different IoT messaging protocols by DZone user Chanaka Fernando.

March 17, 2016

by Chanaka Fernando

CORE

· 49,618 Views · 17 Likes

Apache Kafka Performance Tuning

Apache Kafka is a great solution for handling real-time data feeds. Learn more about tuning Kafka to meet your high performance needs in this great video.

March 17, 2016

by Rohit Dhall

· 14,213 Views · 16 Likes

The Future of Data and Databases

Consolidation around big data with rationalization down to 10 core technologies.

March 14, 2016

by Tom Smith

CORE

· 13,771 Views · 3 Likes

Build an Online Store With MongoDB, Node.js, and Elasticsearch

Check out the following infographics and brief break-down to help you visualize and understand the decisions involved in choosing a microservice architecture.

March 4, 2016

by Siva Prasad Rao Janapati

· 22,336 Views · 15 Likes

Word Count Program With MapReduce and Java

In this post, we provide an introduction to the basics of MapReduce, along with a tutorial to create a word count app using Hadoop and Java.

March 3, 2016

by Shital Kat

· 443,218 Views · 31 Likes

Linking Apache Ignite and Apache Kafka for Highly Scalable and Reliable Data Processing

Here's how to link Apache Kafka and Ignite, for maintaining scalability and reliability for data processing. We'll explore injecting data with KafkaStreamer, as well as IgniteSinkConnector.

March 3, 2016

by Roman Shtykh

· 23,162 Views · 13 Likes

Real-time Data Pipelines with Kafka Connect

Information about Kafka Connect sourced from Spark Summit East 2016.

February 19, 2016

by Tim Spann

CORE

· 15,951 Views · 5 Likes

Loading Data Into Azure SQL Data Warehouse

I’m not an ETL expert. In fact, I haven’t done any professional ETL work for several years. My skills are, at best, rusty. With this in mind, I knew I’d have a hard time extracting data from a local database in order to move it up to Azure SQL Data Warehouse. Read on to hear about my journey.

February 18, 2016

by Grant Fritchey

· 13,910 Views · 6 Likes

Making the Impossible Possible with Tachyon: Accelerate Spark Jobs from Hours to Seconds

Barclays Data Scientist Gianmario Spacagna and Harry Powell, Head of Advanced Analytics, describe how they iteratively process raw data directly from the central data warehouse into Spark and how Tachyon is their key enabling technology.

February 16, 2016

by Henry Powell

· 36,833 Views · 8 Likes

Report Finds Wearables Will Skyrocket in the Enterprise

Wearables have infiltrated the IoT space, but they're relegated mainly to the consumer market. However, 2016 may see wider adoption in the enterprise. Check out what APX Labs discovered in a recent report, "What's Next in Wearable Technology."

February 12, 2016

by Amy Groden-Morrison

· 4,094 Views · 1 Like

Executives' Perspectives on the Evolution of Data Management

Data management has evolved very rapidly since the introduction of Hadoop and big data.

February 12, 2016

by Tom Smith

CORE

· 5,255 Views · 1 Like

Solr vs Elasticsearch: Battle of The Query DSLs

Comparing Solr and Elasticsearch on how they control ranking, and how their query DSLs stack up against each other.

February 10, 2016

by Doug Turnbull

· 10,502 Views · 11 Likes

Fundamentals of Big Data Log Analytics

A presentation and slide deck on using several different tools including Graylog Splunk, and TIBCO to analyze log data.

February 8, 2016

by Kai Wähner

CORE

· 9,863 Views · 3 Likes

Problems Being Solved With Databases — Executives' Perspectives

Databases are enabling companies to use data to inform real-time decisions about their business as well as to use predictive analytics to make better informed, real-time decisions.

February 8, 2016

by Tom Smith

CORE

· 22,358 Views · 2 Likes

What Are the Most Important Elements of Databases?

The most important elements of the database depend upon the application at hand.

February 7, 2016

by Tom Smith

CORE

· 22,632 Views · 3 Likes

The Latest Big Data Topics