Data Engineering Resources

Webhooks vs. Polling: You're Better Than This

Polling and webhooks provide your application with a way of consuming new event data from an endpoint, but one is much more efficient.

June 24, 2017

by Ross Garrett

· 32,271 Views · 7 Likes

Why You Should Optimize Your Local Git Repository From Time to Time

With SSD for Git, you can use GIt without any performance problems — even when you've got some large repositories. Read on to find out how.

June 23, 2017

by Ricci Gian Maria

· 10,597 Views · 4 Likes

A Tale of Slow Pagination

Don’t neglect your pagination queries when speeding up your app and save yourself a few "Ugh why is this so slow?" per day.

June 23, 2017

by Richard Schneeman

· 5,801 Views · 1 Like

Mocking Database Endpoints in MUnit Tests

When I first started, I was having issues using the Mock message processor in MUnit to mock message processors. Learn how to spare yourself of this mistake.

June 23, 2017

by Kian Ting

· 17,992 Views · 4 Likes

ESP8266 WiFi Touchscreen Thermostat

Learn to make your own touchscreen thermostat controlled by WiFi with this guide to the parts and code required to build it from scratch.

June 23, 2017

by Igor Jarc

· 11,609 Views · 1 Like

Using Apache MiniFi on Edge Devices: Part 1

Apache MiniFi lets you safely ingest data on Raspberry Pi and other devices. Learn how to set up a NiFi flow in part 1 of this tutorial.

June 23, 2017

by Tim Spann

CORE

· 12,166 Views · 3 Likes

MongoDB Indexes With Spring Data

Look at annotations that can be applied to a class to create indexes that have been specified within the class. See what indexes do and how they can decrease query times.

June 22, 2017

by Dan Newton

· 68,913 Views · 7 Likes

Learn how to better protect your users and yourself by using Single Sign ON login to authenticate passwords and user IDs.

June 22, 2017

by Prosper Otemuyiwa

· 72,152 Views · 8 Likes

Monitoring the Weather With InfluxDB and Grafana (and a Bunch of Arduinos)

Learn how one weather and IoT enthusiast built a weather station with Arduinos to measure temperature, humidity, and more.

June 22, 2017

by Tom O'connor

· 23,177 Views · 7 Likes

3 Alternatives to the Shadow Brokers' Subscription Plan

The malignant hacker collective is at it again. This time, don't be caught unawares. Follow theres three simples security steps and keep your data safe.

June 21, 2017

by Giridhara Raam

· 4,312 Views · 2 Likes

Reviewing Open-Source Business Intelligence Tools

Review some open-source Business Intelligence tools that are built to simplify planning, analysis, and reporting with one software suite.

June 21, 2017

by Luba Belokon

· 17,166 Views · 7 Likes

NMEA Data Acquisition: An IoT Exercise With Python

This comprehensive post covers the basic data arc that many IoT projects have—exploration, modeling, filtering, and persistence—using Python.

June 21, 2017

by Steven Lott

· 14,213 Views · 4 Likes

Deep Dive Into OCR for Receipt Recognition

No matter what you choose, an LSTM or another complex method, there is no silver bullet. Some methods are hard to use and not always useful.

June 21, 2017

by Ivan Ozhiganov

· 79,953 Views · 13 Likes

A Service Mesh for Kubernetes (Part 4): CD via Traffic Shifting

See how to use linkerd’s routing rules, called dtabs, to automatically alter traffic flow through your app at the end of a CI/CD pipeline.

June 20, 2017

by Alex Leong

· 5,464 Views · 2 Likes

Data Hiding Using JsonIgnore and Spring Data JPA

Take a look at a couple of annotations you can use to hide fields from a Jackson parser. We cover how to do it and the security concerns involved.

June 20, 2017

by Martin Farrell

· 81,013 Views · 3 Likes

Spark Streaming vs. Kafka Streaming

If event time is very relevant and latencies in the seconds range are completely unacceptable, Kafka should be your first choice. Otherwise, Spark works just fine.

June 19, 2017

by Mahesh Chand Kandpal

· 141,149 Views · 31 Likes