Data Engineering Resources

13 Software Failures of 2016 That Testing Could Have Prevented

As businesses continue to migrate to digital platforms, it becomes absolutely critical to conduct rigorous software testing before the launching of a product.

January 2, 2017

by Hiren Tanna

· 28,236 Views · 2 Likes

Running MongoDB Aggregations on Secondaries

Shifting aggregation to a secondary, such as with batch operations, can save your primaries for more pressing, time-sensitive matters.

January 1, 2017

by Vaibhaw Pandey

· 10,896 Views · 2 Likes

Integrate an H2 Database in Your Spring Boot App

You have created a Spring Boot application and would like to integrate with an H2 database. What do you do?

January 1, 2017

by Jose Praveen

· 280,811 Views · 23 Likes

Clean Up Your Workbench With a VNC Server on a Raspberry Pi

Avoid having too many input and output devices on your workbench by using a virtual network computing server, and an accompanying viewer, and a Rasbperry Pi.

January 1, 2017

by Erich Styger

· 15,134 Views · 4 Likes

Triggering Lambda Functions With an AWS IoT Button

It turns out that it's easy to merge serverless architecture with your IoT projects by having AWS IoT Button trigger an AWS Lambda function.

December 31, 2016

by Arun Gupta

· 14,285 Views · 4 Likes

ETL vs Pure SQL

Which one will come out on top? You should definitely check out the results so you can decide which one to use for your next project.

December 30, 2016

by Mateusz Komendołowicz

· 7,356 Views · 5 Likes

Using In-Memory Database in MuleSoft With Apache Derby

You have a file with two million records and you need to filter the values to find a certain match. How do you query such a database?

December 30, 2016

by Ujjawal Kant

· 11,703 Views · 5 Likes

On Databases, Temporal Data Types, and Trains

Temporal data types—those dealing with time—can be troublesome if not handled correctly. See how they've developed and how to implement them properly.

December 29, 2016

by Anders Karlsson

· 11,575 Views · 4 Likes

Using Apache POI to Convert Excel to an Elasticsearch Compatible JSON

Let's see what happens when you upload data into an Elasticsearch index and learn why Logstash was not the answer.

December 29, 2016

by Bipin Patwardhan

· 8,628 Views · 1 Like

Single vs. Multiple Filters in the Java Stream API

It might be tempting to run multiple filters in your streams, but be careful—it might come with a cost. Use your filters judiciously.

December 29, 2016

by A N M Bazlur Rahman

CORE

· 116,058 Views · 6 Likes

Inferno JS: Build and Authenticate an App - Part I

In this 3-part tutorial, we'll introduce the Inferno JavaScript library, then build a simple Inferno app and authenticate it with Auth0.

December 29, 2016

by Kim Maida

· 13,648 Views · 4 Likes

Finding NiFi Errors

Not sure how to find NiFi errors (especially the odd ones)? Learn how to hunt it down so you can move on with your task or project.

December 28, 2016

by Tim Spann

CORE

· 8,023 Views · 2 Likes

Bulk Indexing With ElasticSearch

If your case requires a lot of document indexing, then extensive care should be taken to speed up the process. bulkIndex can help.

December 28, 2016

by Cagatay Gokcel

· 31,536 Views · 9 Likes

Integrate Spring Boot and EC2 Using Cloudformation

Getting your Spring application up and running on top of an EC2 instance is pretty simple.

December 28, 2016

by Emmanouil Gkatziouras

CORE

· 10,680 Views · 4 Likes

Working With Oracle JET UI Web Components

Learn the basics for working with Oracle JET UI web components with help from the JET Cookbook.

December 28, 2016

by Chris Muir

· 27,100 Views · 10 Likes

How to Back Up Your Data Volumes to Docker Hub

Backing up changes that you've made to the container is pretty simple, but backing them up to the data volume is a little more difficult.

December 27, 2016

by Eran Avidan

· 25,632 Views · 4 Likes

Performance Ingredients for NoSQL: Intersect Scans in N1QL

Query processing is one of the most complex and complicated areas in the database realm. Intersect scans leverage multiple indexes for a query and bring subtle performance characteristics.

December 26, 2016

by Prasad Varakur

· 7,065 Views · 4 Likes

Variables in DataWeave

It is possible to define variables in DataWeave header, DataWeave body, and flow variables before the DataWeave component in a Mule flow in DataWeave code.

December 26, 2016

by Swati Deshpande

· 42,321 Views · 5 Likes

Row Store vs. Column Store Databases

For data analysis, look to a column store. To record transactions, a row-based database is probably more helpful. Ideall, thought, you'd have both.

December 26, 2016

by Rick Gobla

· 64,262 Views · 4 Likes

Monitoring OpenStack With the ELK Stack

Elasticsearch, Logstash, and Kibana (ELK) form an open source stack that has become a a leading log analysis platform to monitor, in this case, OpenStack.

December 25, 2016

by Asaf Yigal

· 12,272 Views · 6 Likes

The Latest Data Engineering Topics