Data Engineering Resources

Where You Rate-Limit APIs Matters

This article explains API scaling concepts and how to rate-limit an API effectively.

August 14, 2016

by Lori MacVittie

· 11,551 Views · 8 Likes

Environment-Agnostic Testing and Test Data Management for End-to-End Test Stability

Some examples of patterns for end-to-end test stability and dealing with its challenges.

August 12, 2016

by Sahas Subramanian

· 5,265 Views · 3 Likes

Why Most Programmers Get Pagination Wrong

Lukas Eder tells us what is wrong with pagination on most sites, who actually gets it right, and how they do it.

August 12, 2016

by Lukas Eder

· 103,702 Views · 38 Likes

Named Parameters in JDBC Queries

A simple guide for how and when to use the Parameters class in your JDBC queries.

August 11, 2016

by Greg Brown

· 33,840 Views · 4 Likes

Securing Apache Spark Shuffle Using Apache Commons Crypto

Learn how the performance advantages of the Crypto cryptographic library will provide an upgrade for Spark shuffle encryption over the current approach.

August 11, 2016

by Cheng Xu

· 6,056 Views · 3 Likes

Working to Avoid the Drowning Effects of Real-time

The problem isn't the amount of information, it is the emotional toll of real-time.

August 10, 2016

by Kin Lane

· 2,375 Views · 4 Likes

MuleSoft: Map a Complex Object to DataWeave With a Fixed-Width Format

Learn the steps needed (and the reasons why they're needed) to update a legacy app involving mapping complex objects to DataWeave with fixed widths.

August 10, 2016

by Sulthony H

· 23,266 Views · 4 Likes

API Gateway Custom Authorization With Lambda, DynamoDB, and CloudFormation

See how to set up your own API Gateway authorization when using an assortment of tools, including Amazon's Lambda and DynamoDB and CloudFormation.

August 10, 2016

by Michael Wittig

· 18,448 Views · 2 Likes

Building a Web UI for PostgreSQL DBs in Plain Java

This guide walks you through the process of connecting to PostgreSQL databases from Java web applications using MyBatis and Spring Framework. The UI part will be built using Vaadin Framework which allows you to build modern single-page web apps with only Java.

August 9, 2016

by Alejandro Duarte

CORE

· 19,429 Views · 12 Likes

Apache CloudStack vs. OpenStack: Which Is the Best?

CloudStack and OpenStack are two giants in the CMP realm. But where are they best used? See how their components compare head-to-head.

August 9, 2016

by Milita Datta

· 16,465 Views · 9 Likes

Scan DynamoDB Items With Node.js

Tap into DynamoDB's scanning ability with some quick JavaScript. Be warned, though, that it might be more expensive than it's worth.

August 7, 2016

by Emmanouil Gkatziouras

CORE

· 19,792 Views · 3 Likes

Effective Bulk Data Import into Neo4j (Part 3)

Here we are, the finale! Today, we take a look at LOAD JSON, a piece of the import puzzle that converts JSON to a CSV.

August 7, 2016

by Mark Needham

· 5,451 Views · 1 Like

Testing Docker Multi-Host Network Performance

This post reviews Docker's multi-host network performance. Read on to see what the results are and if they're in line with other results.

August 5, 2016

by Vadim Tkachenko

· 5,410 Views · 2 Likes

Resizing the HashMap: Dangers Ahead

The problems with threading on Hashmap and leaky abstractions. The use of proper monitoring and careful use of data structures is very important in modern coding.

August 4, 2016

by Nikita Salnikov-Tarnovski

· 15,863 Views · 20 Likes

REST API vs. SOAP Web Services Management

Let's take a step back and look at the rise of microservices and REST and the apparent decline of SOAP-based web services. What are the statistics and the reasons?

August 4, 2016

by Guy Levin

· 13,597 Views · 9 Likes

Building a Mock HVAC for Smart Thermostat Demos

Here's a handy tutorial that shows you step-by-step how to set up and wire a mock HVAC system for shows on the road.

August 4, 2016

by James Ward

· 4,089 Views · 2 Likes

JOIN Faster With Couchbase Index JOINs

Take a look at Couchbase's index JOINs — a way to perform JOINs quickly and without parents having references to their children documents.

August 3, 2016

by Keshav Murthy

CORE

· 18,377 Views · 10 Likes

Neo4j With Scala: An Introduction

Are you a Scala user who's interested in getting started with Neo4j? Look no further!

August 2, 2016

by Anurag Srivastava

· 11,911 Views · 5 Likes

Future of FinTech Depends on APIs

It's easy to forget how interconnected our money is becoming with the world around us. See how APIs are playing an essential role in the modern economy.

August 2, 2016

by Ken Tien

· 9,710 Views · 4 Likes

A Quick Guide to Writing Dynamic SQL in PL/SQL

Here are some options and examples to get you started writing Dynamic SQL when using PL/SQL.

August 1, 2016

by Steven Feuerstein

· 28,405 Views · 4 Likes

The Latest Data Engineering Topics