Data Engineering Resources

Restricting Access to EC2 Instances Based on Tags

Here's a refresher on the principle of least privilege and a code snippet that will help configure your EC2 instance security.

August 20, 2018

by Andreas Wittig

· 5,749 Views · 3 Likes

Creating a REST API Part 5: Manual Pagination, Sorting, and Filtering

In this post, you'll make the API more flexible by adding pagination, sorting, and filtering capabilities.

Updated August 20, 2018

by Dan McGhan

· 77,259 Views · 7 Likes

3 Ways to Generate Random Variables in JMeter

Random numbers are useful in testing, like when you need a random URL. Learn how to generate random numbers in JMeter.

August 19, 2018

by Leticia Almeida

· 37,191 Views · 1 Like

Machine Learning vs Deep Learning

What is the difference between Machine Learning and Deep Learning? Let's take a look at the answer in this article.

August 18, 2018

by Shailna Patidar

· 74,980 Views · 8 Likes

Increase Test Coverage With Automation

Test coverage is important, and increasing it offers many benefits. See how automation can help you achieve this.

August 17, 2018

by Federico Toledo

· 18,113 Views · 3 Likes

Testing Features of ML Models

In this post, you will learn about different types of test cases that you could come up for testing features of the data science/Machine Learning models.

Updated August 17, 2018

by Ajitesh Kumar

· 9,938 Views · 2 Likes

Micronaut Mastery: Using Reactor Mono and Flux

Let's take a look at how to use Project Reactor as the implementation for the Reactive Streams API in Micronaut.

August 17, 2018

by Hubert Klein Ikkink

· 13,454 Views · 3 Likes

Capturing Request Logs From Signal Sciences

This post looks at capturing request data logs from Signal Sciences in cybersecurity monitoring.

August 17, 2018

by Phillip Maddux

· 4,906 Views · 1 Like

Access Azure Key Vault From Your Kubernetes Pods

A pod's gotta have its secrets. Take a look at how you can allow your applications within Kubernetes pods to access Azure Key Vault securely.

August 17, 2018

by Sam Cogan

· 13,816 Views · 2 Likes

MDC: A Better Way of Logging

Want to learn more about analyzing logs with multiple clients? Check out this post to learn more about using MDC as a better way of logging.

August 17, 2018

by Shuvankar Ghosh

· 156,909 Views · 29 Likes

PySpark: Java UDF Integration

The main topic of this article is the implementation of UDF (User Defined Function) in Java invoked from Spark SQL in PySpark.

August 17, 2018

by Kiran Kumar

· 29,742 Views · 5 Likes

Install a Hadoop Cluster on Ubuntu 18.04.1

We explore how to install a multiple node Hadoop 3.1.1 cluster on your Ubuntu-based system. Read on to get started with this powerful big data framework!

August 16, 2018

by Bill Ward

· 50,355 Views · 9 Likes

Python REST API Example (With Microservices) — Part 1

Writing REST APIs with Python is an important skill for the microservices world. We'll start learning the steps with a basic class in this tutorial.

August 16, 2018

by Bill Ward

· 58,585 Views · 20 Likes

How to Style Images With Markdown

This post presents a variety of ways to format images with Markdown, from brute force to proprietary syntax extensions, unwise hacks, and everything in between.

August 15, 2018

by B Jones

· 48,541 Views · 2 Likes

Graphite Grafana: Metrics Monitoring Made Easy

In this post we are going to learn how to monitor time series data by installing Graphite and Grafana on Ubuntu Server 18.04.

August 15, 2018

by Bill Ward

· 13,444 Views · 1 Like

How to Initialize a String Member

There are several ways to initialize a string member when working in C++. What way works best for your projects? Read on to find out!

August 15, 2018

by Bartłomiej Filipek

· 11,373 Views · 2 Likes

Intro to Querying Neo4j Using OGM

Let's take a look at how to add examples of querying the data that was loaded in the previous article.

August 15, 2018

by Scott Sosna

CORE

· 9,624 Views · 3 Likes

Encrypting Sensitive Data Stored on S3

S3 offers a bunch of options to encrypt your data at rest. Check out this tutorial to learn more about using server-side and client-side encryption with S3!

August 15, 2018

by Michael Wittig

· 9,691 Views · 2 Likes

PouchContainer Goroutine Leak Detection Practices

Take a look at what may be going on under the hood of your golang projects, as well as what you can to do to detect and prevent goroutine leaks.

Updated August 15, 2018

by Leona Zhang

· 3,729 Views · 1 Like

20 Best Practices for Working With Apache Kafka at Scale

In this post, a software engineer gives a great look at 20 ways fellow developers and data scientists can use Apache Kafka to its utmost.

August 15, 2018

by Tony Mancill

· 100,333 Views · 35 Likes

The Latest Data Engineering Topics