Data Engineering Resources

Apache Spark and Apache NiFi Integration (Part 2 of 2)

Let's finish off our journey of integrating Apache Spark and Apache NiFi to cover both data ingestion and running Apache Spark jobs.

February 15, 2018

by Tim Spann

CORE

· 29,703 Views · 7 Likes

What's The Most Important Part of the Open Source Ecosystem?

The community of users and contributors who share their knowledge, experience, and insights to improve collaboration, innovation, quality, and security.

February 15, 2018

by Tom Smith

CORE

· 7,033 Views · 5 Likes

What Do We Mean by Database Scalability?

This lesson in database performance defines scalability and elasticity in the context of DBs, then offers some advice for resource management.

February 15, 2018

by Craig S. Mullins

· 28,296 Views · 4 Likes

Azure SQL Database vs. Azure SQL Data Warehouse

Let's look at two seemingly similar products from Microsoft: Azure SQL Database and Azure SQL Data Warehouse. We'll see how they compare and when to use which one.

February 15, 2018

by Barry Luijbregts

· 17,392 Views · 4 Likes

JMeter Parameterization: The Complete Guide

If you're wondering about how to parameterize your scripts in JMeter, then this is the resource for you. Come have a look!

February 14, 2018

by Yuri Bushnev

· 38,275 Views · 7 Likes

What Azure Availability Zones Are and Why You Should Use Them

For enterprises using Azure for their virtual machine needs, you may be excited to learn about the rollout of Availability Zone for your backup solutions.

February 14, 2018

by Alex Bennett

· 11,589 Views · 4 Likes

API Quota API, Webhooks, and Server-Sent Events (SSE)

An API quota API is useful for when you depend on a single API but is something that becomes almost critical when it comes to depending on many APIs

February 14, 2018

by Kin Lane

· 8,211 Views · 6 Likes

Machine Learning With Decision Trees

This paper shows you how to get started with machine learning by applying decision trees using Python on an established dataset.

February 14, 2018

by Alan Brown

· 13,330 Views · 6 Likes

Using PMM With External Monitoring Services

Let's see how you can use Percona Monitoring and Management's new support for external monitoring services to give you more versatility in your tool selection.

February 14, 2018

by Borys Belinksy

· 9,036 Views · 1 Like

GitOps: High-Velocity CI/CD for Kubernetes

Check out this presentation for techniques for teams aiming for high-velocity continuous delivery using Kubernetes and Docker.

February 14, 2018

by Alexis Richardson

· 24,683 Views · 8 Likes

Hashing With SHA-256 in Oracle 11g R2

Want to bring the SHA-256 Hashing algorithm to Oracle 11g R2? Here is how to implement a hashing method that isn't natively supported by the database.

February 14, 2018

by Emrah Mete

· 49,388 Views · 6 Likes

Develop Custom Ensemble Models Using Caret in R

Here we review some different ways to create ensemble learning models and compare the accuracy of their results, seeing how each functions better as a composite.

February 13, 2018

by Sibanjan Das

CORE

· 16,268 Views · 7 Likes

Scala vs. Python for Apache Spark

When using Apache Spark for cluster computing, you'll need to choose your language. Scala has its advantages, but see why Python is catching up fast.

February 13, 2018

by Tim Spann

CORE

· 31,689 Views · 13 Likes

AWS Cognito User Pool Access Token Invalidation

Since the integrated tools in AWS Cognito aren't enough to invalidate a token once a sign out has been triggered, here's a helpful workaround.

February 13, 2018

by Ugur ARPACI

· 41,595 Views · 5 Likes

Integrate Camunda BPMN With MySQL

In this quick post, we take a look at all the XML code and terminal commands you need to integrate these two interesting technologies.

February 13, 2018

by Praveen Buya

· 13,833 Views · 8 Likes

The Developer's Guide to Collections

It's time for a deep dive into collections in Java, including the defining philosophy of collections, important methods, and advice for implementation.

February 13, 2018

by Justin Albano

CORE

· 48,085 Views · 92 Likes

Apache Ignite: Setup Guide

If you're looking to get started with Apache Ignite, this is the post for you. Learn steps for binary installation, building from sources, and Maven.

February 12, 2018

by Gaurav Rai Mazra

· 10,424 Views · 5 Likes

Machine Learning: Validation Techniques

In this post, you will briefly learn about different validation techniques: resubstitution, hold-out, k-fold cross-validation, LOOCV, random subsampling, and bootstrapping.

February 12, 2018

by Ajitesh Kumar

· 44,033 Views · 5 Likes

Basics for Setting Up a Microservices Architecture in a Project for Spring Boot and Gradle

Learn about the components needed to build microservices architecture in a project for Spring Boot and Gradle to enable continuous delivery/deployment.

February 12, 2018

by Akash Bhingole

· 49,454 Views · 40 Likes

A Beats Tutorial: Getting Started

Get acquainted with the E:L stack and working with the different beats: Filebeat, Packetbeat, Metricbeat, Auditbeat, Heartbeat, and Winlogbeat.

February 12, 2018

by Daniel Berman

· 14,428 Views · 6 Likes

The Latest Data Engineering Topics