Data Engineering Resources

Monitoring the Weather With InfluxDB and Grafana (and a Bunch of Arduinos)

Learn how one weather and IoT enthusiast built a weather station with Arduinos to measure temperature, humidity, and more.

June 22, 2017

by Tom O'connor

· 23,219 Views · 7 Likes

3 Alternatives to the Shadow Brokers' Subscription Plan

The malignant hacker collective is at it again. This time, don't be caught unawares. Follow theres three simples security steps and keep your data safe.

June 21, 2017

by Giridhara Raam

· 4,337 Views · 2 Likes

Reviewing Open-Source Business Intelligence Tools

Review some open-source Business Intelligence tools that are built to simplify planning, analysis, and reporting with one software suite.

June 21, 2017

by Luba Belokon

· 17,203 Views · 7 Likes

NMEA Data Acquisition: An IoT Exercise With Python

This comprehensive post covers the basic data arc that many IoT projects have—exploration, modeling, filtering, and persistence—using Python.

June 21, 2017

by Steven Lott

· 14,234 Views · 4 Likes

Deep Dive Into OCR for Receipt Recognition

No matter what you choose, an LSTM or another complex method, there is no silver bullet. Some methods are hard to use and not always useful.

June 21, 2017

by Ivan Ozhiganov

· 80,028 Views · 13 Likes

A Service Mesh for Kubernetes (Part 4): CD via Traffic Shifting

See how to use linkerd’s routing rules, called dtabs, to automatically alter traffic flow through your app at the end of a CI/CD pipeline.

June 20, 2017

by Alex Leong

· 5,464 Views · 2 Likes

Data Hiding Using JsonIgnore and Spring Data JPA

Take a look at a couple of annotations you can use to hide fields from a Jackson parser. We cover how to do it and the security concerns involved.

June 20, 2017

by Martin Farrell

· 81,043 Views · 3 Likes

Spark Streaming vs. Kafka Streaming

If event time is very relevant and latencies in the seconds range are completely unacceptable, Kafka should be your first choice. Otherwise, Spark works just fine.

June 19, 2017

by Mahesh Chand Kandpal

· 141,215 Views · 31 Likes

Mule API Manager

Here's an introduction to the functions and implementation of API Manager, a Mule Anypoint Platform component for building and publishing APIs.

June 19, 2017

by Venu R

· 16,109 Views · 4 Likes

Streaming in Spark, Flink, and Kafka

There is a lot of buzz going on between when to use Spark, when to use Flink, and when to use Kafka. Get it all straight in this article.

June 18, 2017

by Shivangi Gupta

· 55,483 Views · 26 Likes

A Guide to the B-Tree Index

In this article, I will be explaining what a B-tree index is, how it works, and how you can easily create one in Oracle.

June 17, 2017

by Ben Brumm

· 46,033 Views · 5 Likes

XData and SambaCry Add to the Whopping Number of Data Breaches This Year

While the repercussions of WannaCry have finally been dealt with, a whole new batch of ransomware and malware is lurking right around the corner.

June 16, 2017

by Giridhara Raam

· 4,300 Views · 1 Like

How to Make Mobile Apps Work Offline

You want your mobile app to be usable as much as possible. Let's look at the challenges and solutions for app development for offline functionality.

June 16, 2017

by Yura Bondarenko

· 101,697 Views · 6 Likes

API Testing With Postman Collections in AWS CodePipeline

Learn how to setup an AWS CodePipeline to run Postman collections for testing REST APIs with AWS CodeCommit and CodeBuild.

June 16, 2017

by Unmesh Gundecha

· 14,829 Views · 3 Likes

A Graphical Notation for Kubernetes API Objects

The Kubernetes Deployment Language, or KDL, is standardizing their API objects into buckets, much like containerization.

June 15, 2017

by Kin Lane

· 5,040 Views · 3 Likes

What Is Variable Importance and How Is It Calculated?

Variable Importance (VI) helps data scientists weed out certain predictors that are contributing to nothing and that instead add time to processing.

June 15, 2017

by Avkash Chauhan

· 27,206 Views · 5 Likes

A Service Mesh for Kubernetes (Part 3): Encrypting all the Things

Now that you've integrated linkerd with Kubernetes, it's important to add security to your communications by encrypting your HTTP calls with TLS.

June 15, 2017

by Alex Leong

· 6,481 Views · 3 Likes

The Mystery of Eureka Self-Preservation

Here, we examine a quick overview of how Eureka's self-preservation mode works as well as a couple of traps to avoid, depending on your network.

June 14, 2017

by Fahim Farook

· 26,641 Views · 8 Likes

Troubleshooting Problems With MySQL Replication

As with any other aspect of database management, replication doesn't always proceed as expected. Check out some solutions to real-world MySQL replication issues.

June 13, 2017

by Darren Perucci

· 15,266 Views

Characteristics of Good APIs

If a user interacts with your code via code of their own, you’re building an API. Consequently, understanding properties of good APIs is vital. So what makes a good API?

June 13, 2017

by Erik Dietrich

· 15,436 Views · 3 Likes

The Latest Data Engineering Topics