Big Data Resources

How to Process Nasty Fixed Width Files Using Apache Spark

Fixed width files can be a pain. Learn how to get around the issues they present using Scala and Spark.

April 19, 2019

by Subhasish Guha

· 30,389 Views · 6 Likes

Introduction to Elasticsearch and the ELK Stack, Part 1

In this post, we cover the frameworks that make up the ELK stack (Elasticsearch, Logstash, Kibana [plus Beats]) and how they all work together.

Updated April 18, 2019

by Ayush Jain

· 20,431 Views · 9 Likes

10 Best JavaScript Charting Libraries for Any Data Visualization Need

If you're interested in learning how to visualize your findings, read on for a list of great data viz libraries to help get you started.

April 18, 2019

by Ruslan Borovikov

· 40,767 Views · 15 Likes

Installing the EFK Stack With Kubernetes With GKE

In this article, we take a look at a relatively new app available in GKE's app marketplace called, rather succinctly, "Elastic GKE Logging."

April 17, 2019

by Daniel Berman

· 10,901 Views · 4 Likes

Database Migration Tools

In this post, we take a look at the three main kinds of database migration tools (on-premise, open source, and cloud-based) and the situation in which each is best.

April 16, 2019

by Garrett Alley

· 33,514 Views · 3 Likes

Lambda Architecture: How to Build a Big Data Pipeline, Part 2 [Video]

We walk you through how to provide a robust system that is fault-tolerant against hardware failures and human mistakes using the Lambda architecture approach.

April 16, 2019

by Alexsandro Souza

· 10,063 Views · 4 Likes

Google Colab: Create Predictive Models in No Time

In this article, we will see how we can use this amazing cloud-based platform and use a Random Forest model to predict customer churn in less than 200 lines of code.

April 12, 2019

by Sunil Kappal

· 15,958 Views · 2 Likes

Entity Framework Core 3.0 and SQL Server Performance Optimization, Part 1: Parameters Sniffing

Implement SQL Server performance optimization using the Entity Framework Core and parameter sniffing.

April 12, 2019

by Bassam Alugili

· 51,626 Views · 7 Likes

Ingesting Data From Files With Apache Spark, Part 1

In this post, a data expert teaches us how to take in large data sets using Apache Spark.

April 8, 2019

by Jean-Georges Perrin

· 15,878 Views · 7 Likes

Logging HTTP Request Metadata With Nginx, Lua, Logstash, and Elasticsearch

This post shows how to use Nginx, Lua, Logstash, and Elasticsearch to log, store, and analyze HTTP request and response metadata.

April 3, 2019

by smotti

· 21,246 Views · 3 Likes

Advanced XML Processing With Apache NiFi 1.9.1

In this post, we'll be using Apache NiFi to simply process very complex XML and RSS data files.

April 2, 2019

by Tim Spann

CORE

· 20,629 Views · 7 Likes

Spark Streaming vs. Structured Streaming

In this post, we compare these two popular open source data platforms and the scenarios where each work best.

March 29, 2019

by Anuj Saxena

· 76,777 Views · 5 Likes

Performance of Pipeline Architecture: The Impact of the Number of Workers

The number of workers in a pipe-line architecture can drastically impact performance.

March 27, 2019

by Nihla Akram

· 14,795 Views · 8 Likes

Top 5 Enterprise ETL Tools

If you're looking to adopt a new tools to help perform ETL process, check out this list of five options and see which one fits your needs.

March 25, 2019

by Vitaliy Samofal

· 40,058 Views · 10 Likes

Building Open Source Google Analytics from Scratch

Check out this article that shows you how to build your own analytics platform with AWS and Cube.js.

March 25, 2019

by Pavel Tiunov

· 17,127 Views · 8 Likes

Elasticsearch on Google Cloud Platform

Take a look at this simple and quick tutorial about downloading and connecting Elasticsearch to your GCP instance.

Updated March 20, 2019

by Sameer Chandra

· 19,868 Views · 3 Likes

How to Effectively Use ExecutorService in Kafka Consumers

Apache Kakfa is one of the most popular open source tools for working with big data and streaming data. Learn a little bit more about Kakfa with this tutorial.

March 19, 2019

by Prasanth Nair

· 44,974 Views · 9 Likes