Big Data Resources

Guide to Partitions Calculation for Processing Data Files in Apache Spark

Spark chooses the number of partitions implicitly while reading a set of data files into an RDD or a Dataset. This implicit process of selecting the number of portions is described comprehensively in this story.

June 19, 2020

by Ajay Gupta

· 22,598 Views · 3 Likes

Kafka Replication — Manipulate Your Topics and Records in Mirror Maker V1.0 and V2.0

Using the features of a tool might not enough. Check how to insert your own Java code into the Kafka mirror maker tools.

Updated June 18, 2020

by Rodrigo Loza

· 11,822 Views · 1 Like

Python Packages for Data Science

In this article, we have covered the top Python Data Science Libraries which you should know if you want to master Data Science.

June 17, 2020

by Vijay Singh Khatri

CORE

· 22,130 Views · 3 Likes

Microservices, Event-Driven Architecture and Kafka

In this article, we discuss some basics behind microservices and event-driven architecture and explain how Kafka fits in to both.

Updated June 16, 2020

by Ioan Tinca

· 40,272 Views · 12 Likes

The Fastest JavaScript Data Grid — A Performance Analysis

There are many data grid offerings in the market that tout enhanced capabilities to display and manage analysis. We set out to see which popular offerings can withstand the true test of performance as it relates to “Big Data”.

June 16, 2020

by David Greene

· 9,735 Views · 3 Likes

Your First Java RDD With Apache Spark

Build a simple spark RDD with the the Java API.

June 16, 2020

by Terrence Munyunguma

· 12,262 Views · 3 Likes

Red Hat Data Grid 8 for Beginners

This article describes how to get started with Data Grid Server 8.0 which is isolated from the Red Hat JBoss Enterprise Application Platform.

Updated June 12, 2020

by Varsha Sharma

· 11,496 Views · 7 Likes

IoT Applications Are Headed for Edge

At the conceptual level, edge computing refers to the idea of bringing computing closer to where it's consumed or closer to the sources of data.

June 11, 2020

by Ishu Verma

· 10,136 Views · 3 Likes

10 Trends in the Internet of Things That Will Disrupt the Tech World in 2020

The IoT has begun to permeate the consumer, communications, and industrial worlds. Here are 10 trends to predict what comes next for IoT solution providers.

June 9, 2020

by Rahul Asthana

· 11,673 Views · 5 Likes