Data Engineering Resources

Processing Hierarchical Data Using Spark GraphX Pregel API

Learn about using the GraphX Pregel API, a very powerful tool that can be used to solve iterative problems and pretty much any graph computation.

September 30, 2017

by Suraj Bang

· 16,670 Views · 2 Likes

Reading Nested Parquet File in Scala and Exporting to CSV

In this brief, yet code-heavy tutorial, learn how to handle nested Parquet compressed content and remove certain columns of your data.

September 30, 2017

by Avkash Chauhan

· 10,458 Views · 3 Likes

Packers, How They Work, Featuring UPX

A security researcher demonstrates how to get packers, specifically UPX, up and running on our system. Read on to learn more!

September 30, 2017

by Christopher Lamb

· 22,567 Views · 1 Like

Building a Realtime Chat App With Django and Fanout Cloud

In this tutorial, we show you how to create a web-based, communication application using these two free platforms. Read on for more!

September 30, 2017

by Justin Karneges

· 18,430 Views · 4 Likes

Recover Deleted Data From SQL Table Using Transaction Log and LSNs

As the SQL Server database is a highly popular relational DBMS among corporate sectors and businesses, the issue of data loss is critical.

September 29, 2017

by Prashanth Jayaram

· 224,167 Views · 3 Likes

FinTech Continues to Disrupt the Digital API Economy. What's Next?

See the ways in which the emergence of FinTech and the accompanying digital products signifies a major shift in the API economy.

Updated September 29, 2017

by Ross Garrett

· 6,197 Views · 1 Like

Cool SQL Optimizations That Do Not Depend on the Cost Model (Part 1)

Learn about five simple optimizations that can be implemented purely based on metadata (i.e. constraints) and the query itself.

September 29, 2017

by Lukas Eder

· 4,986 Views · 4 Likes

Cloud-Agnostic Object Storage for Everybody!

See how you can use Minio and Cloud 66 to handle production-grade object storage without worrying about cloud vendor lock-in.

September 29, 2017

by Daniël van Gils

· 6,993 Views · 1 Like

Aggregate Millions of Database Rows in a Spring Controller

Learn how to perform ultra-fast aggregations in Java with Spring and Speedment—even with large datasets with millions of rows.

September 28, 2017

by Emil Forslund

· 34,277 Views · 15 Likes

Should You API-Enable Your IBM i (AS/400)?

See how leveraging APIs can benefit IBM i users, and how you can integrate it to support the functionality that APIs offer.

September 28, 2017

by Robert Young

· 10,855 Views · 4 Likes

How to Ensure the Security of Your APIs

Learn how to implement security measures for your APIs by following the steps in this detailed tutorial on defining a custom OAuth2.0 security scheme.

September 28, 2017

by Nagarjunareddy K

· 28,929 Views · 2 Likes

Benchmarking Google Cloud Spanner, CockroachDB, and NuoDB

Take a deep dive into three elastic SQL databases, all of which are pretty promising options that meet the needs of the modern data center.

September 28, 2017

by Boris Bulanov

· 12,013 Views · 4 Likes

How Did MongoDB Get Its Name?

Maybe you use MongoDB daily — but do you even know where the name 'MongoDB' came from? Take a break and learn how your favorite database got its name.

September 27, 2017

by Brian Wheeler

· 6,636 Views · 1 Like

Mastering RediSearch (Part 1)

If you’ve built an app with Redis as a primary data store, you’ve likely experienced the confusion of the native data types. Ease this confusion by learning how RediSearch stores data.

September 27, 2017

by Kyle Davis

· 10,395 Views · 6 Likes

Top 12 AI Tools, Libraries, and Platforms

If you're looking to start an AI project but don't know where to start, check out this article. We've listed the top 12 AI tools, libraries, and platforms, what they are typically used for, what pros and cons they come with, and more!

September 27, 2017

by Sarah Davis

· 38,064 Views · 10 Likes

How to Initialize Database Variables and Assign Them Values in JMeter

Learn how to initialize database variables and how to assign them values when working with only one Thread Group using JMeter.

September 26, 2017

by Aleksey Merzlyakov

· 12,383 Views · 2 Likes

Apache Flink vs. Apache Spark

Should you switch to Apache Flink? Should you stick with Apache Spark for a while? Or is Apache Flink just a new gimmick? Get the answers to these and other questions.

September 26, 2017

by Ivan Mushketyk

· 54,762 Views · 15 Likes

C++11 Performance Tip: Update on When to Use std::pow

Take a look at this benchmark to see when to use std::pow in C++, comparing the performance of std::pow against direct multiplications

Updated September 26, 2017

by Baptiste Wicht

· 4,850 Views · 1 Like

Understanding API Design

This in-depth guide to API design will help you understand the types of APIs, their structure, and how to make calls and navigate them.

September 26, 2017

by Nagarjunareddy K

· 12,535 Views · 14 Likes

Developing a Basic Web Application Using Python

In this in-depth, code-heavy tutorial, learn how to use Python to create basic web apps. Once you know how to do this, you can make any web app to fit your needs!

September 26, 2017

by Arnny Y

· 117,513 Views · 8 Likes

The Latest Data Engineering Topics