Data Engineering Resources

Hooking Up MuleSoft and AWS, Part 1: Amazon Athena

In Part 1 of this AWS/Mule tutorial series, learn how to integrate Amazon Web Services' Amazon Athena with flows in MuleSoft.

July 10, 2017

by Yasir Siraj

· 9,735 Views · 3 Likes

Software Development Peer Reviews: Five Lessons Learned From the Experience

If you're looking to implement peer reviews into your development process, read on to get a great overview of the how the process is used and works best.

Updated July 9, 2017

by Pablo Cruz Navea

· 16,271 Views · 4 Likes

Pivoting and Unpivoting Multiple Columns in MS SQL Server

In this article, we'll discuss converting values of rows into columns (PIVOT) and values of columns into rows (UNPIVOT) in MS SQL Server.

Updated July 9, 2017

by Rathnadevi Manivannan

· 253,546 Views · 5 Likes

Filebeat vs. Logstash — The Evolution of a Log Shipper

This comparison of log shippers Filebeat and Logstash reviews their history, and when to use each one- or both together.

July 8, 2017

by Daniel Berman

· 29,807 Views · 12 Likes

Microservices: Access Properties From Spring Cloud Config Server

Learn how to write a microservice that can be used to access centralized properties files on a Spring Cloud config server.

July 7, 2017

by Shamik Mitra

· 47,419 Views · 4 Likes

The Most Important Lessons Learned From Data Science Projects

The biggest advantage of data science over traditional statistics is that it can draw conclusions from a junk pile of the supposedly unrelated information.

July 7, 2017

by Chris Richardson

· 9,504 Views · 2 Likes

Using SQL Census to Audit SQL Server Permissions

SQL Census is a desktop app that inspects your SQL Server and Active Directory to produce a clear overview of each user’s permissions. Read on to learn how it works.

July 7, 2017

by Ally Parker

· 2,808 Views · 1 Like

Big Data Ingestion: Flume, Kafka, and NiFi

Flume, Kafka, and NiFi offer great performance, can be scaled horizontally, and have a plug-in architecture where functionality can be extended through custom components.

July 7, 2017

by Tony Siciliani

· 89,178 Views · 24 Likes

NATS: The Good, Gotchas, and Some Awesome Features

Read about some of the great features, and the catches, of the NATS open source messaging system for cloud native apps, IoT messaging, and microservices architectures.

July 6, 2017

by Karolis R

· 5,908 Views · 4 Likes

Microservices and Spring Cloud Config Server

Spring Cloud's config server capabilities make updating microservices across your system a breeze. Let's walk through setting up and changing properties step by step.

July 5, 2017

by Shamik Mitra

· 91,550 Views · 33 Likes

PGP Encryption and Decryption With Apache Camel

Learn how to implement PGP security to encrypt and decrypt files with Apache Camel to protect sensitive files, emails, and other information.

July 5, 2017

by Jitendra Bafna

CORE

· 38,166 Views · 7 Likes

Shell: Create a Comma Separated String

In this quick tutorial, we go over how to use Shell scripting in a pinch to create working strings of code that will help us make basic calculations.

July 5, 2017

by Mark Needham

· 11,179 Views · 1 Like

A Look at 5 NoSQL Solutions

Even though it's been with us for some time now, it's sometimes beneficial to review what NoSQL actually is and take a look at some NoSQL-based solutions.

July 5, 2017

by Erik Dietrich

· 11,384 Views · 10 Likes

How to Automatically Migrate All Tables From a Database to Hadoop With No Coding

This is a great tool for instantly moving over tables from relational databases. This is also a great way to quickly build up a data lake.

July 5, 2017

by Tim Spann

CORE

· 19,875 Views · 7 Likes

Connecting Apache Kafka With Mule ESB

Learn about the capabilities of the Apache Kafka message queuing system and how to integrate it with Mule ESB in this tutorial.

July 4, 2017

by Jitendra Bafna

CORE

· 21,335 Views · 9 Likes

What Are the Keys To Automated Testing?

Strategic automation of the entire CI/CD/DevOps process reduces the amount of human interaction with testing and data.

July 3, 2017

by Tom Smith

CORE

· 11,334 Views · 7 Likes

Gluster Storage for Kubernetes With Heketi

Running stateful applications on Kubernetes is doable, and we'll use Gluster, Heketi, and Google Cloud Platform to see it in action.

July 3, 2017

by Harshal Shah

· 12,967 Views

28 Artificial Intelligence Terms You Need to Know

Some of the biggest definitions that you need to know when it comes to artificial intelligence.

July 2, 2017

by Sarah Davis

· 139,410 Views · 68 Likes

Monitoring DC/OS Nodes and Containers With cAdvisor, InfluxDB, and Grafana

Learn how to install and configure a DC/OS monitoring stack with cAdvisor, InfluxDB, and Grafana to gather, export, store, and display detailed metrics.

June 30, 2017

by Fernando Sanchez

· 5,815 Views · 1 Like

Apache Spark Performance Tuning – Degree of Parallelism

Today we learn about improving performance and increasing speed through partition tuning in a Spark application running on YARN.

June 30, 2017

by Rathnadevi Manivannan

· 101,606 Views · 8 Likes

The Latest Data Engineering Topics