Big Data Resources

Apache Spark: 3 Reasons Why You Should Not Use RDDs

When it comes to building an enterprise-grade app in Spark, RDD isn't a good choice. Why? And if RDD is not a good choice, then what should we use?

March 8, 2018

by Himanshu Gupta

· 47,084 Views · 11 Likes

Deploying Elasticsearch 6.x on Azure With Terraform

Today, we will be looking at deploying a full Elasticsearch cluster using best practices end-to-end on Microsoft Azure.

March 6, 2018

by Itamar Syn-hershko

· 9,377 Views · 3 Likes

Spring Cloud Stream With Kafka

In this post, we take a look at how you can build a real-time streaming microservices application by using Spring Cloud Stream and Kafka.

March 6, 2018

by David Kiss

· 118,056 Views · 55 Likes

Logging With the Elastic Stack

It's imperative to have a system that can analyze large amounts of logs and present a singular view. Centralized logging provided by the Elastic Stack is a step in the right direction.

March 5, 2018

by Vaibhav Raizada

· 14,308 Views · 13 Likes

Kubernetes Monitoring: Best Practices, Methods, and Existing Solutions

Kubernetes handles containers in several computers, removing the complexity of handling distributed processing. But what's the best way to perform Kubernetes monitoring?

Updated February 23, 2018

by Daniel Berman

· 19,321 Views · 4 Likes

Simple Java Program to Append to a File in HDFS

Get the code and instructions needed to build a Java program to append to a file in HDFS, using Maven as the build tool.

February 23, 2018

by Simarpreet Kaur Monga

· 18,102 Views · 4 Likes

The Tech Files: Pushing Jupyter Notebooks to Production

Learn how one company embarked upon their data science journey to incorporate recommendation algorithms into their client-facing product.

February 21, 2018

by Teja Srivastasa

· 19,808 Views · 4 Likes

How to Be a Master in Software Development

Here are some of the subjects and general topics that you should familiarize yourself with to achieve mastery in software development.

February 20, 2018

by Alexsandro Souza

· 12,834 Views · 35 Likes

Introduction to Basic Statistics Measurements

Learn about the most common statistical methods that can help make data-driven decisions and understand the fundamental concepts of statistics in a jargon-free way.

February 16, 2018

by Sunil Kappal

· 12,656 Views · 10 Likes

Apache Spark and Apache NiFi Integration (Part 2 of 2)

Let's finish off our journey of integrating Apache Spark and Apache NiFi to cover both data ingestion and running Apache Spark jobs.

February 15, 2018

by Tim Spann

CORE

· 30,394 Views · 7 Likes

What's The Most Important Part of the Open Source Ecosystem?

The community of users and contributors who share their knowledge, experience, and insights to improve collaboration, innovation, quality, and security.

February 15, 2018

by Tom Smith

CORE

· 7,335 Views · 5 Likes

Azure SQL Database vs. Azure SQL Data Warehouse

Let's look at two seemingly similar products from Microsoft: Azure SQL Database and Azure SQL Data Warehouse. We'll see how they compare and when to use which one.

February 15, 2018

by Barry Luijbregts

· 17,941 Views · 4 Likes

Machine Learning With Decision Trees

This paper shows you how to get started with machine learning by applying decision trees using Python on an established dataset.

February 14, 2018

by Alan Brown

· 14,101 Views · 6 Likes

Develop Custom Ensemble Models Using Caret in R

Here we review some different ways to create ensemble learning models and compare the accuracy of their results, seeing how each functions better as a composite.

February 13, 2018

by Sibanjan Das

· 16,920 Views · 7 Likes

Scala vs. Python for Apache Spark

When using Apache Spark for cluster computing, you'll need to choose your language. Scala has its advantages, but see why Python is catching up fast.

February 13, 2018

by Tim Spann

CORE

· 32,396 Views · 13 Likes

A Beats Tutorial: Getting Started

Get acquainted with the E:L stack and working with the different beats: Filebeat, Packetbeat, Metricbeat, Auditbeat, Heartbeat, and Winlogbeat.

February 12, 2018

by Daniel Berman

· 15,313 Views · 6 Likes

MQTT + Apache Kafka + InfluxDB + SQL = IoT Harmony

This is a deep dive into real-time and time series IoT data using MQTT, Apache Kafka, InfluxDB, Lenses, and a handful of SQL code.

February 11, 2018

by Stefan Bocutiu

· 29,540 Views · 18 Likes

Real-World Problems Being Solved By Open Source

Learn about the real-world problems open source is tackling - pretty much everything, since 90 to 95% of all apps are built with open source software.

February 10, 2018

by Tom Smith

CORE

· 12,152 Views · 2 Likes

Java High-Level REST Client: Elasticsearch

Learn about using a Java high-level REST client with Elasticsearch to use API-specific methods that accept request objects as an argument and return response objects.

February 7, 2018

by Divya Dua

· 83,766 Views · 4 Likes

Dynamic Configuration Management in Microservice Architecture With Spring Cloud

Improve your own dynamic configuration management with Spring Cloud while learning how easy it is to reconfigure your application live without rebuilding or rebooting it.

February 5, 2018

by Bartłomiej Słota

· 62,484 Views · 12 Likes

The Latest Big Data Topics