Data Engineering Resources

Generating AVRO Schemas for Data and Making Sure Names Are Correct

Learn how to use Apache NiFi to generate AVRO schemas while ensuring that the field names meet strict naming conventions.

December 13, 2017

by Tim Spann

CORE

· 20,821 Views · 2 Likes

This Week in Spring: SpringOne, PWAs, and IBM Middleware

This grab bag of Spring-related news touches on Spring Tool Suite, what happened at SpringOne, tips for Progressive Web Apps, and IBM Middleware.

Updated December 13, 2017

by Josh Long

· 7,865 Views · 3 Likes

CRUD Operation With ASP.NET Core MVC Using ADO.NET and Visual Studio 2017

Introduction In this article, I am going to explain how to create an MVC web application in ASP.NET Core 2.0 using ADO.NET. We will be creating a sample Empl...

December 13, 2017

by Ankit Sharma

· 143,377 Views · 12 Likes

A Step-by-Step Guide for Protecting Sensitive Data in Docker

In this tutorial, you'll learn how to create and manage Docker secrets in order to increase your container and cloud security.

December 13, 2017

by Jatin Demla

· 17,301 Views · 7 Likes

Cleanup Old Docker Images from Nexus Repository

To keep Docker image management easy, someone built a Nexus CLI to clean up old Docker Images. See how to use it and consider helping out with the project on GitHub.

December 13, 2017

by Mohamed Labouardy

· 16,233 Views · 6 Likes

Microservices on the JVM With Actors

When it comes to bringing microservices to the JVM, it's hard to go wrong with Akka and its actor model. Let's see how they contribute to microservices adoption.

December 12, 2017

by Markus Eisele

· 23,359 Views · 16 Likes

How to Find and Fix Memory Leaks in Your Java Application

Do you have a Java app that runs fine at first but slows down after a while? Or, perhaps it runs fine for a small number of files but performance degrades when the number of files increases? You might have a memory leak...

December 12, 2017

by Leo Ufimtsev

· 121,729 Views · 29 Likes

Trying to Represent a Tree Structure Using Postgres

I'll be publishing a series of blog posts on the Postgres LTREE extension. I'll get started today by trying to insert a tree structure into a Postgres table using standard SQL.

December 12, 2017

by Pat Shaughnessy

· 18,710 Views · 4 Likes

The 20 Most Interesting Things Werner Vogels Said at AWS re:Invent

Interested in an overview of Werner Vogels' thoughts on the future of AWS? Look no further than this compilation, and check out the keynote video!

December 11, 2017

by Fredric Paul

· 13,263 Views · 3 Likes

Using Jolt in Big Data Streams to Remove Nulls

Learn how to use Jolt code within your big data streams to remove null values with some example source data and JSON code.

December 9, 2017

by Tim Spann

CORE

· 12,625 Views · 3 Likes

PL/SQL 101: Nulls in PL/SQL

You need to understand nulls, the NULL value, the NULL statement, and how nulls can cause confusion and errors. Then, take steps to avoid that confusion and those errors.

December 8, 2017

by Steven Feuerstein

· 23,483 Views · 2 Likes

Processing HL7 Records

Learn how to ingest and convert HL7 records to usable Apache Hive tables for SQL queries, machine learning, and analysis in your Hadoop data lake.

December 8, 2017

by Tim Spann

CORE

· 10,249 Views · 4 Likes

The Effect of Cardinality on Data Ingest (Part 1)

Many times, the cardinality of data can be rather large compared to the amount of data to be ingested. Let's investigate more by testing the performance of a database.

December 8, 2017

by Ed Bernier

· 5,921 Views · 2 Likes

MuleSoft With OpenAPI Specification

In this walkthrough, you'll learn about API design and management in MuleSoft using the OpenAPI Specification, formerly Swagger.

December 8, 2017

by Rakesh Kumar Jha

· 16,694 Views · 4 Likes

Apache Kafka: How to Load Test With JMeter

In today's post, we take a look at how you can load test your Apache Kafka setup using JMeter. Read on for more details.

December 7, 2017

by Roman Aladev

· 22,153 Views · 8 Likes

2017 DevOps Surprises

You never know what the year will bring in development, like DevOps and Cloud's strong positive correlation that begets containers and microservices.

December 7, 2017

by Tom Smith

CORE

· 9,795 Views · 3 Likes

Integrating AWS Machine Learning Models With Your Java Microservice

In this post we take a look at incorporating AWS machine learning into your Java microservice environment. Interested? Read on for the details and some code.

December 7, 2017

by Mike Mackrory

· 6,119 Views · 3 Likes

Network Stubbing Options for XCTest and XCUITest in Swift

This post explores all the options available to test your iOS app's network layer in Swift, as well as network stubbing libraries to use with the XCTest framework.

Updated December 7, 2017

by Shashikant Jagtap

· 17,335 Views · 2 Likes