Data Engineering Resources

Real-time Data Pipelines with Kafka Connect

Information about Kafka Connect sourced from Spark Summit East 2016.

February 19, 2016

by Tim Spann

CORE

· 16,745 Views · 5 Likes

Four Easy Steps to Set Up Multi-Store in OpenCart

OpenCart is one of the most popular eCommerce platforms available on the market today. In this article, we will walk through the simple steps involved in setting up the multi-store feature using a single OpenCart installation.

February 19, 2016

by Saumil Shah

· 10,124 Views · 2 Likes

Loading Data Into Azure SQL Data Warehouse

I’m not an ETL expert. In fact, I haven’t done any professional ETL work for several years. My skills are, at best, rusty. With this in mind, I knew I’d have a hard time extracting data from a local database in order to move it up to Azure SQL Data Warehouse. Read on to hear about my journey.

February 18, 2016

by Grant Fritchey

· 14,291 Views · 6 Likes

The Most Important Elements of Cloud-Based Applications

Scalability, security, cost savings, integration/connectivity, and stability/availability are all important elements of cloud-based applications.

February 18, 2016

by Tom Smith

CORE

· 9,135 Views · 3 Likes

How to Build Angular 2 Apps Using Observable Data Services — Pitfalls to Avoid

In this post, we are going to see how an Angular 2 application can be built around the concept of observable data services. Read on to learn more.

February 18, 2016

by Vasco Cavalheiro

· 81,621 Views · 5 Likes

Expecting Failures in Microservices and Working Around Them

Learn more about microservice failures, and ways to circumvent failures in this excerpt from "Microservices in .NET."

February 17, 2016

by Christian Horsdal

· 28,818 Views · 7 Likes

Making the Impossible Possible with Tachyon: Accelerate Spark Jobs from Hours to Seconds

Barclays Data Scientist Gianmario Spacagna and Harry Powell, Head of Advanced Analytics, describe how they iteratively process raw data directly from the central data warehouse into Spark and how Tachyon is their key enabling technology.

February 16, 2016

by Henry Powell

· 38,143 Views · 8 Likes

Write JUnit Tests in Spring With Mocked and Real Objects

How to use mocked and non-mocked data to write unit tests using the free and open source JUnit framework.

February 16, 2016

by Saravanan Kandasamy

· 17,392 Views · 7 Likes

Graph Databases 101

Let’s talk about graph databases. Some industry watchers claim that they are the fastest-growing type of database. If so, maybe it’s useful to know more about them. So, let's start with the basics: what is a graph database, and what is it useful for?

February 16, 2016

by Adnan Khaleel

· 14,574 Views · 14 Likes

RetroPie N64 Emulator Performance Tweaks

RetroPie is great for your retro gaming needs, but unfortunately, N64 ROM performance is decidedly hit or miss. The Runcommand Launch allows emulator-switching, for selection of the best emulator for a specific ROM. Check out how to install additional emulators, boot into the Runcommand menu, and see a user-aggregated list of ROM performance.

February 16, 2016

by Moe Long

CORE

· 63,042 Views · 2 Likes

What’s the Difference Between OLTP and OLAP?

As you plan your analytics and data architecture on AWS, you may get confused between Redshift and Aurora. Both are advertised to be scalable and performant. Both are supposedly better than incumbents. Both have optically inspired names. So, what’s the difference?

February 16, 2016

by Kiyoto Tamura

· 17,649 Views · 4 Likes

Report Finds Wearables Will Skyrocket in the Enterprise

Wearables have infiltrated the IoT space, but they're relegated mainly to the consumer market. However, 2016 may see wider adoption in the enterprise. Check out what APX Labs discovered in a recent report, "What's Next in Wearable Technology."

February 12, 2016

by Amy Groden-Morrison

· 4,502 Views · 1 Like

Running AWS Lambda Functions in AWS CodePipeline Using CloudFormation

Recently, AWS announced that they’ve added support for triggering AWS Lambda functions into AWS CodePipeline–AWS’ Continuous Delivery service. In this article, I’ll describe how I codified the provisioning of all of the AWS resources in the documentation using CloudFormation.

February 12, 2016

by Paul Duvall

· 18,012 Views · 1 Like

Executives' Perspectives on the Evolution of Data Management

Data management has evolved very rapidly since the introduction of Hadoop and big data.

February 12, 2016

by Tom Smith

CORE

· 5,734 Views · 1 Like

The SOLID Principles in Real Life

You're likely familiar with the SOLID principles. Here's a breakdown of the SOLID principles in a real-world setting.

February 12, 2016

by Erik Dietrich

· 228,697 Views · 110 Likes

Enable Docker Remote API on Docker Machine on Mac OS X

Check out how to enable the Docker Remote REST API on a Docker Machine running on Mac OS X in this neat tutorial!

February 12, 2016

by Arun Gupta

· 9,700 Views · 2 Likes

Create a JSON API REST Service With Spring Boot and Elide

Learn how to make a HSON API REST service using Elide and Spring Boot in this awesome tutorial. The JSON API is a great specification for developers, and is getting much more popular.

February 11, 2016

by Matthew Casperson

· 71,839 Views · 10 Likes

ES6 Math Functions You Can Use Today

In this article, we'll discuss the various math functions—what they are and how they work—available in ECMAScript 2015 (ES6). Read on to learn more.

February 10, 2016

by Josh Anderson

· 7,557 Views · 2 Likes

MySQL Password Expiration Features to Help You Comply With PCI-DSS

PCI Compliance requires users to change their passwords every 90 days. Luckily, since MySQL version 5.6.6 there’s a password_expired feature which allows one to set a user’s password as expired.

February 10, 2016

by Peter Zaitsev

· 6,258 Views · 2 Likes

Solr vs Elasticsearch: Battle of The Query DSLs

Comparing Solr and Elasticsearch on how they control ranking, and how their query DSLs stack up against each other.

February 10, 2016

by Doug Turnbull

· 11,008 Views · 11 Likes

The Latest Data Engineering Topics