Data Engineering Resources

Ring Buffer: A Data Structure Behind Disruptor

In this article, we look at Disruptor, a library for passing messages between threads, and look at how it's data structure enables high performance.

December 21, 2017

by Grzegorz Mirek

· 22,921 Views · 6 Likes

The Evolution of EC2 Network Performance: m3, m4, and m5

So, are AWS EC2's fancy new m5 instances worth it? In a word: yes. See the performance impact and cost savings you can expect.

December 21, 2017

by Andreas Wittig

· 12,042 Views · 4 Likes

Data Visualizations With InfluxDB and Plotly.js

Walk through creating data visualizations with InfluxDB and plotly.js, a JavaScript graphing library built on top of d3.js and stack.gl.

December 20, 2017

by Margo Schaedel

· 13,971 Views · 3 Likes

Implicit vs. Explicit Cursor: Which Should You Use?

"Hmmm," you might be saying to yourself, "a conversation about SQL queries in a post on conditional logic? That's strange." Ah, but maybe not so strange.

December 20, 2017

by Steven Feuerstein

· 7,759 Views · 2 Likes

Elasticsearch for Dummies

Get to know the basics of Elasticsearch, its advantages, how to install it, and how to index documents using Elasticsearch.

December 20, 2017

by Alex Mailajalam

· 9,947 Views · 1 Like

Install oh-my-zsh on Windows

This tutorial is for Windows users who want to set up oh-my-zsh, an open source framework for managing your z shell, or ZSH, configuration.

December 20, 2017

by Michal Bocek

· 27,730 Views · 2 Likes

Row Level Security in Hibernate Using @Filter

Learn how to give certain people permission to view certain parts of your database, and thus increase your database's security.

December 20, 2017

by Ali Akbar Azizkhani

· 21,960 Views · 12 Likes

Highly Available Docker Registry on AWS With Nexus

Want a place to keep your Docker images that won't fail when the chips are down? See how you can create an HA repo on AWS using Nexus.

December 20, 2017

by Mohamed Labouardy

· 11,192 Views · 5 Likes

Making Graph Databases Fun Again With Java

Graph databases need to be made fun again! Not to worry — the open-source TinkerPop from Apache is here to do just that.

December 20, 2017

by Otavio Santana

CORE

· 22,081 Views · 12 Likes

Looking Inside Postgres at a GiST Index

What does the GiST API do? And what does it mean to extend Postgres’s indexing system, exactly? Read on to find out!

December 19, 2017

by Pat Shaughnessy

· 11,370 Views · 5 Likes

How to Pick Different CSV Files at JMeter Runtime

A CSV file is a file that enables users to represent data in a table format. Learn how to manipulate CSV files using the open source tool JMeter.

December 19, 2017

by Sebastian Lorenzo

· 16,524 Views · 2 Likes

Data Transformation: CSV to XML With Apache Camel

Learn how to convert a CSV message into XML using Camel Apache Processor, or from any format into another, with code examples.

Updated December 19, 2017

by Jitendra Bafna

CORE

· 41,274 Views · 7 Likes

Communicating Between Microservices

Inter-service communication is essential to consider when building microservices. Learn about the characteristics and benefits of different communication styles.

December 19, 2017

by Piotr Mińkowski

· 197,218 Views · 107 Likes

Data Modelling: Counter Table

Sometimes, you need to avoid failure scenarios where in-memory systems aren't suitable. In those cases, I recommend using an aggregate counter table.

December 19, 2017

by Jonathan Levin

· 9,745 Views · 2 Likes

Data Transformation: XML to JSON And JSON to XML With Apache Camel

In this tutorial, you will learn how to achieve data transformation by converting XML to JSON and JSON to XML with Apache Camel.

December 19, 2017

by Jitendra Bafna

CORE

· 55,255 Views · 7 Likes

Check out this great article on to learn how to create authentication and authorization protocols in your web application using ASP.NET.

December 19, 2017

by Kelvin Santos Amorim

· 44,058 Views · 4 Likes

EC2 Network Performance Demystified: m3 and m4

Choosing the right AWS EC2 instance for your network can be a challenge, so here are some benchmarks for m3 and m4 instances to help your decision making.

December 18, 2017

by Andreas Wittig

· 7,361 Views · 1 Like

SAML-Based SSO With Azure AD B2C as an IDP

While signing on might not be the most fun thing for users, for devs, it's a critical part of the process of application security.

December 18, 2017

by Shanky Munjal

· 16,264 Views · 3 Likes

Saving a Tree in Postgres Using LTREE

Trees are natural, haphazard, and branching; database tables are man-made rectangles full of numbers and text. How can you possibly save a beautiful tree structure into an boring DB table?

December 18, 2017

by Pat Shaughnessy

· 13,996 Views · 2 Likes

Manipulating Trees Using SQL and the Postgres LTREE Extension

Today, I'll show you how to delete, move, and copy branches from one place to another in your tree using @> in combination with other LTREE functions.

December 17, 2017

by Pat Shaughnessy

· 22,284 Views · 5 Likes

The Latest Data Engineering Topics