Big Data Resources

Installing the EFK Stack With Kubernetes With GKE

In this article, we take a look at a relatively new app available in GKE's app marketplace called, rather succinctly, "Elastic GKE Logging."

April 17, 2019

by Daniel Berman

· 10,340 Views · 4 Likes

Database Migration Tools

In this post, we take a look at the three main kinds of database migration tools (on-premise, open source, and cloud-based) and the situation in which each is best.

April 16, 2019

by Garrett Alley

· 32,826 Views · 3 Likes

Lambda Architecture: How to Build a Big Data Pipeline, Part 2 [Video]

We walk you through how to provide a robust system that is fault-tolerant against hardware failures and human mistakes using the Lambda architecture approach.

April 16, 2019

by Alexsandro Souza

· 9,413 Views · 4 Likes

Google Colab: Create Predictive Models in No Time

In this article, we will see how we can use this amazing cloud-based platform and use a Random Forest model to predict customer churn in less than 200 lines of code.

April 12, 2019

by Sunil Kappal

· 15,129 Views · 2 Likes

Entity Framework Core 3.0 and SQL Server Performance Optimization, Part 1: Parameters Sniffing

Implement SQL Server performance optimization using the Entity Framework Core and parameter sniffing.

April 12, 2019

by Bassam Alugili

· 50,655 Views · 7 Likes

Ingesting Data From Files With Apache Spark, Part 1

In this post, a data expert teaches us how to take in large data sets using Apache Spark.

April 8, 2019

by Jean-Georges Perrin

· 15,302 Views · 7 Likes

Logging HTTP Request Metadata With Nginx, Lua, Logstash, and Elasticsearch

This post shows how to use Nginx, Lua, Logstash, and Elasticsearch to log, store, and analyze HTTP request and response metadata.

April 3, 2019

by smotti

· 20,358 Views · 3 Likes

Advanced XML Processing With Apache NiFi 1.9.1

In this post, we'll be using Apache NiFi to simply process very complex XML and RSS data files.

April 2, 2019

by Tim Spann

CORE

· 19,462 Views · 7 Likes

Spark Streaming vs. Structured Streaming

In this post, we compare these two popular open source data platforms and the scenarios where each work best.

March 29, 2019

by Anuj Saxena

· 74,681 Views · 5 Likes

Performance of Pipeline Architecture: The Impact of the Number of Workers

The number of workers in a pipe-line architecture can drastically impact performance.

March 27, 2019

by Nihla Akram

· 14,059 Views · 8 Likes

Top 5 Enterprise ETL Tools

If you're looking to adopt a new tools to help perform ETL process, check out this list of five options and see which one fits your needs.

March 25, 2019

by Vitaliy Samofal

· 39,037 Views · 10 Likes

Building Open Source Google Analytics from Scratch

Check out this article that shows you how to build your own analytics platform with AWS and Cube.js.

March 25, 2019

by Pavel Tiunov

· 16,572 Views · 8 Likes

Elasticsearch on Google Cloud Platform

Take a look at this simple and quick tutorial about downloading and connecting Elasticsearch to your GCP instance.

Updated March 20, 2019

by Sameer Chandra

· 19,397 Views · 3 Likes

How to Effectively Use ExecutorService in Kafka Consumers

Apache Kakfa is one of the most popular open source tools for working with big data and streaming data. Learn a little bit more about Kakfa with this tutorial.

March 19, 2019

by Prasanth Nair

· 43,386 Views · 9 Likes