Data Engineering Resources

Explore database caching with Redis and Java and see some of the different caching strategies.

Updated April 5, 2019

by Nikita Koksharov

· 65,854 Views · 20 Likes

Why Your Spark Applications Are Slow or Failing, Part 1: Memory Management

If you're having trouble with your Spark applications, read on to see if these common memory management issues are plaguing your system.

April 5, 2019

by Rishitesh Mishra

· 139,301 Views · 20 Likes

7 Reasons Why Using SELECT * FROM TABLE in SQL Query Is a Bad Idea

See 7 reasons why using SELECT * FROM TABLE in SQL is not a good idea.

April 5, 2019

by Javin Paul

· 128,330 Views · 15 Likes

Spring Boot/Batch Tutorial: Integration With HBASE REST API and Data Ingestion

In this post, we look at how to integrate these two popular frameworks into your Java app in order to perform data ingestion.

April 5, 2019

by Damodhara Reddy Palavali

· 17,108 Views · 3 Likes

Create and Publish Your Rest API Using Spring Boot and Heroku

In this tutorial, you will learn how to use Spring Boot to develop RESTful API and publish your API to Heroku.

April 4, 2019

by Paul Tofunmi

· 44,171 Views · 12 Likes

A Health Check Playbook for Your Postgres Database

Here's a breakdown of what your regular Postgres health check should look like.

April 4, 2019

by Craig Kerstiens

· 23,443 Views · 4 Likes

Create Location-Aware Ads in Android With the HERE Geofencing API

Inspired by fast food company dev teams, we take a look at how to add geofencing to a mobile application using Java and the HERE API.

April 4, 2019

by Nic Raboy

· 8,218 Views · 2 Likes

Spark Trigger Options

In this article, we'll look at the different trigger options available in Spark Structured Streaming.

April 4, 2019

by Sylvester Daniel

· 27,810 Views · 9 Likes

Building Microservices Through Event-Driven Architecture, Part 1: Application-Specific Business Rules

In this post, we take a cross-disciplinary look into creating microservices by applying the principles of event-driven design.

Updated April 3, 2019

by Gora LEYE

· 45,829 Views · 31 Likes

Logging HTTP Request Metadata With Nginx, Lua, Logstash, and Elasticsearch

This post shows how to use Nginx, Lua, Logstash, and Elasticsearch to log, store, and analyze HTTP request and response metadata.

April 3, 2019

by smotti

· 21,328 Views · 3 Likes

Write Points From CSV to InfluxDB

See how to easily write points from CSV to InfluxDB.

April 3, 2019

by Anais Dotis-Georgiou

· 27,913 Views · 3 Likes

Correlation ID for Logging in Microservices

We take a look at the ideas behind correlation IDs and the role they play while creating log files for microservice applications.

April 2, 2019

by Gaurav Garg

· 127,058 Views · 27 Likes

Spark Structured Streaming Joins

In this artipostle, we'll look at the different joins available in Spark Structured Streaming and how to implement them using Scala.

April 2, 2019

by Sylvester Daniel

· 24,404 Views · 6 Likes

Azure SQL Elastic Pools and SQL Monitor

This article explains the Azure-tailored metrics and alerts in SQL Monitor that track use of the limited compute resources available to an Azure SQL Elastic Pool.

April 2, 2019

by Jon Hayman

· 18,367 Views · 2 Likes

Building a Chatbot With an Expert System

See a bot that addresses the problem of customer self-service internet connection troubleshooting.

April 2, 2019

by Klaus Engelbrecht

· 12,262 Views · 4 Likes

Sharepoint API How-To: Migrating SharePoint Online REST API Storage Operations to the Graph API

See how to migrate SharePoint online REST API storage operations to the Graph API.

April 2, 2019

by smotti

· 20,380 Views · 1 Like

Advanced XML Processing With Apache NiFi 1.9.1

In this post, we'll be using Apache NiFi to simply process very complex XML and RSS data files.

April 2, 2019

by Tim Spann

CORE

· 20,771 Views · 7 Likes

Integration of C-STAT Code Analysis with Automated Jenkins CI Build

Take a look at how you can futher you static code analysis by integrating with Jenkins.

April 2, 2019

by Sankara M

· 12,355 Views · 5 Likes

APIs With Node.js and Express: Automatically Validate API Requests Using an OpenAPI 3 Specification

In this article, we’ll see how an OpenAPI specification can be used to automatically validate API requests.

Updated April 1, 2019

by Carmine DiMascio

· 27,357 Views · 7 Likes

Developer’s Guide: How to Build a Dashboard With JavaScript Libraries

We take a look at two JavaScript libraries that can help devs create effective dashboards to help their org easily access data.

April 1, 2019

by Veronika Rovnik

· 43,069 Views · 14 Likes

The Latest Data Engineering Topics