Data Engineering Resources

On Databases, Temporal Data Types, and Trains

Temporal data types—those dealing with time—can be troublesome if not handled correctly. See how they've developed and how to implement them properly.

December 29, 2016

by Anders Karlsson

· 11,006 Views · 4 Likes

Using Apache POI to Convert Excel to an Elasticsearch Compatible JSON

Let's see what happens when you upload data into an Elasticsearch index and learn why Logstash was not the answer.

December 29, 2016

by Bipin Patwardhan

· 8,183 Views · 1 Like

Single vs. Multiple Filters in the Java Stream API

It might be tempting to run multiple filters in your streams, but be careful—it might come with a cost. Use your filters judiciously.

December 29, 2016

by A N M Bazlur Rahman

CORE

· 114,807 Views · 6 Likes

Inferno JS: Build and Authenticate an App - Part I

In this 3-part tutorial, we'll introduce the Inferno JavaScript library, then build a simple Inferno app and authenticate it with Auth0.

December 29, 2016

by Kim Maida

· 12,740 Views · 4 Likes

Persisting ZipKin SpanStore: MySQL and Cassandra

The ZipKin distributed tracing system is great for testing latency issues, but by default, it doesn't persist the traces. Fortunately, you can fix that with Cassandra and MySQL.

December 28, 2016

by Nitin Ware

· 14,141 Views · 2 Likes

Finding NiFi Errors

Not sure how to find NiFi errors (especially the odd ones)? Learn how to hunt it down so you can move on with your task or project.

December 28, 2016

by Tim Spann

CORE

· 7,613 Views · 2 Likes

Bulk Indexing With ElasticSearch

If your case requires a lot of document indexing, then extensive care should be taken to speed up the process. bulkIndex can help.

December 28, 2016

by Cagatay Gokcel

· 31,032 Views · 9 Likes

Integrate Spring Boot and EC2 Using Cloudformation

Getting your Spring application up and running on top of an EC2 instance is pretty simple.

December 28, 2016

by Emmanouil Gkatziouras

CORE

· 10,295 Views · 4 Likes

Working With Oracle JET UI Web Components

Learn the basics for working with Oracle JET UI web components with help from the JET Cookbook.

December 28, 2016

by Chris Muir

· 26,444 Views · 9 Likes

How to Back Up Your Data Volumes to Docker Hub

Backing up changes that you've made to the container is pretty simple, but backing them up to the data volume is a little more difficult.

December 27, 2016

by Eran Avidan

· 24,975 Views · 4 Likes

Performance Ingredients for NoSQL: Intersect Scans in N1QL

Query processing is one of the most complex and complicated areas in the database realm. Intersect scans leverage multiple indexes for a query and bring subtle performance characteristics.

December 26, 2016

by Prasad Varakur

· 6,562 Views · 4 Likes

Variables in DataWeave

It is possible to define variables in DataWeave header, DataWeave body, and flow variables before the DataWeave component in a Mule flow in DataWeave code.

December 26, 2016

by Swati Deshpande

· 41,890 Views · 5 Likes

Row Store vs. Column Store Databases

For data analysis, look to a column store. To record transactions, a row-based database is probably more helpful. Ideall, thought, you'd have both.

December 26, 2016

by Rick Gobla

· 63,573 Views · 4 Likes

Monitoring OpenStack With the ELK Stack

Elasticsearch, Logstash, and Kibana (ELK) form an open source stack that has become a a leading log analysis platform to monitor, in this case, OpenStack.

December 25, 2016

by Asaf Yigal

· 11,706 Views · 6 Likes

Configuring Memory for MapReduce Running on YARN

There are times when a MapReduce job exceeds its memory limits. This article presents an overview of how YARN monitors the memory for containers and provides the technique to fix this issue.

December 23, 2016

by Alex Holmes

· 61,846 Views · 2 Likes

Server Log Analysis: It's More Important Than Google Analytics

This article discusses the significance of analyzing the server logs. The author also demonstrates a server log dashboard created using the open source ELK Stack of Elasticsearch, Logstash, and Kibana.

December 23, 2016

by Samuel Scott

· 15,791 Views · 8 Likes