Big Data Resources

Advanced XML Processing With Apache NiFi 1.9.1

In this post, we'll be using Apache NiFi to simply process very complex XML and RSS data files.

April 2, 2019

by Tim Spann

CORE

· 20,592 Views · 7 Likes

Spark Streaming vs. Structured Streaming

In this post, we compare these two popular open source data platforms and the scenarios where each work best.

March 29, 2019

by Anuj Saxena

· 76,705 Views · 5 Likes

Performance of Pipeline Architecture: The Impact of the Number of Workers

The number of workers in a pipe-line architecture can drastically impact performance.

March 27, 2019

by Nihla Akram

· 14,755 Views · 8 Likes

Top 5 Enterprise ETL Tools

If you're looking to adopt a new tools to help perform ETL process, check out this list of five options and see which one fits your needs.

March 25, 2019

by Vitaliy Samofal

· 40,014 Views · 10 Likes

Building Open Source Google Analytics from Scratch

Check out this article that shows you how to build your own analytics platform with AWS and Cube.js.

March 25, 2019

by Pavel Tiunov

· 17,090 Views · 8 Likes

Elasticsearch on Google Cloud Platform

Take a look at this simple and quick tutorial about downloading and connecting Elasticsearch to your GCP instance.

Updated March 20, 2019

by Sameer Chandra

· 19,858 Views · 3 Likes

How to Effectively Use ExecutorService in Kafka Consumers

Apache Kakfa is one of the most popular open source tools for working with big data and streaming data. Learn a little bit more about Kakfa with this tutorial.

March 19, 2019

by Prasanth Nair

· 44,936 Views · 9 Likes

Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)

Explore the differences between Apache Kafka as an Event Streaming Platform and integration middleware.

March 19, 2019

by Kai Wähner

CORE

· 42,468 Views · 10 Likes

What Is the Difference Between Metrics and Events?

We gather all types of data from our systems when we adopt monitoring technologies and tools.

March 18, 2019

by Katy Farmer

· 7,074 Views · 3 Likes

The Open-Closed Principle at an Architectural Level

The Open-Closed Principle, with microservices? Madness! Well, maybe not. Let's dive into it and check it out.

March 15, 2019

by David Llobregat

· 36,082 Views · 52 Likes

Lambda Architecture: How to Build a Big Data Pipeline, Part 1

We take a look at the basic steps needed to create a big data application for streaming and analyzing data from edge devices.

March 13, 2019

by Alexsandro Souza

· 21,083 Views · 4 Likes

Migrating MySQL Data to ElasticSearch Using Logstash

We take a look at how to use some of the most popular tools in the world of data to effectively perform the migration of big data sets.

March 13, 2019

by Shriram Untawale

· 61,156 Views · 7 Likes

Five Skills Needed to Master Your Role in HPC

New to a role in High Performance Computing (HPC)? Find out the top five skills that you’ll need to succeed.

Updated March 12, 2019

by Jeff Reser

· 9,363 Views · 3 Likes

Kafka to HDFS/S3 Batch Ingestion Through Spark

Learn the basics of batch and data integration using Apache Spark and Spark jobs. We just know it'll spark your interest.

Updated March 12, 2019

by Swapnil Chougule

· 24,995 Views · 3 Likes

How to Choose the Right IoT Connectivity Protocol for Your Connected Device

Choosing the right IoT connectivity protocol for your business is an important decision.

March 12, 2019

by Jeffrey Lee

· 16,498 Views · 11 Likes

Object Detection Tutorial in TensorFlow: Real-Time Object Detection

In this object detection tutorial, we’ll focus on deep learning object detection as TensorFlow uses deep learning for computation.

March 12, 2019

by Kislay Keshari

· 119,493 Views · 8 Likes

Using GPU in TensorFlow Model

This tutorial explains how to increase our computational workspace by making room for TensorFlow GPU.

March 11, 2019

by Rinu Gour

· 10,479 Views · 1 Like

Apache Kafka With Scala Tutorial

We take a look at the concepts governing the popular Apache Kafka framework and how to implement it in our projects using Scala.

March 8, 2019

by Shubham Dangare

· 68,383 Views · 13 Likes

Using Jakarta EE/MicroProfile to Connect to Apache Kafka: Part 1 — Hello World

Learn how to securely integrate Apache Kafka with Eclipse MicroProfile.

March 7, 2019

by Otavio Santana

CORE

· 19,101 Views · 12 Likes

Using Python Pandas for Log Analysis

In this quick article, I'll walk you through how to use the Pandas library for Python in order to analyze a CSV log file for offload analysis.

March 6, 2019

by Akshay Ranganath

· 34,232 Views · 5 Likes

The Latest Big Data Topics