Big Data Resources

Introducing Hive-Kafka Integration for Real-Time Kafka SQL Queries

In this article, we take a look at the SQL access pattern for Kafka and how to get it tp work with the new Kafka Hive Integration.

January 3, 2019

by George Vetticaden

· 25,570 Views · 11 Likes

Using GridGain With Kafka Connector

We look at how to integrate two interesting big data technologies that allow data professionals to work with streaming data.

January 3, 2019

by Akmal Chaudhri

CORE

· 7,734 Views · 13 Likes

Applications of Word Embeddings in NLP

In this post, we look at some of the practical uses of Word Embeddings (Word2Vec) and Domain Adaptation.

January 3, 2019

by Shashank Gupta

· 10,462 Views · 1 Like

Interpreting Kafka's Exactly-Once Semantics

Apache Kafka comes out-of-the-box packed with great data science features. We take a look at few of them in this post.

January 1, 2019

by Rahul Agarwal

· 28,387 Views · 5 Likes

Introduction to Apache Spark's Core API (Part I)

We take a quick look at how to work with the functions and methods contained in Spark's core API using Python.

December 24, 2018

by Anil AGRAWAL

· 16,064 Views · 5 Likes

How the SQLite Database Works

Let's discuss some architectural details of database implementation by using an early version of SQLite.

Updated December 19, 2018

by Dhanushka Madushan

CORE

· 32,433 Views · 13 Likes

How to Use Elasticsearch With a Spring Data Elasticsearch Project

If you're new to Elasticsearch or need a refresher, read on to learn how to integrate this popular open source searching tool into your application.

December 18, 2018

by Rajesh Bhojwani

· 103,887 Views · 6 Likes

Topology-Based Event Correlation With Apache Spark Streaming

We look at a use case from the telecom industry in which Apache Kafka is used to analyze streaming data from cell towers and edge devices.

December 18, 2018

by Arseniy Tashoyan

· 11,580 Views · 7 Likes

Key Differences Between Apache Ignite, Hazelcast, Cassandra, and Tarantool

The main difference of Apache Ignite from the others is the number of functionalities and simplicity of use.

December 18, 2018

by Shamim Bhuiyan

· 23,632 Views · 8 Likes

HDP 3.1 Released! All The Kafka!

A major upgrade to Hadoop distribution has been released. Read on to learn how to upgrade to it.

December 18, 2018

by Tim Spann

CORE

· 17,608 Views · 7 Likes

How IoT in Transportation Has Made Exponential Growth

Check out the ability of IoT devices and sensors to better manage data for industry.

December 11, 2018

by Sanjeev Verma

· 13,127 Views · 4 Likes

An Overview of the Kafka Distributed Message System (Part 2)

We finish this small series by exploring brokers, topics, partitions, and more in the open source Apache Kafka platform.

December 10, 2018

by Leona Zhang

· 15,169 Views · 9 Likes

An Overview of the Kafka Distributed Message System (Part 1)

Apache Kafka is one of the most popular tools for big data out there. If you're curious as to why, read on to take a look under the hood!

December 7, 2018

by Leona Zhang

· 33,587 Views · 17 Likes

Flink State Management and Fault Tolerance for Real-Time Computing

We look at the processing of stateful streaming data, state interfaces, and the implementation of state management and fault tolerance in Apache Flink.

December 5, 2018

by Leona Zhang

· 11,564 Views · 3 Likes

What Is Amazon Machine Learning: 8 Benefits of AWS ML

Explore eight benefits of Amazon Machine Learning.

Updated December 5, 2018

by Rinu Gour

· 11,077 Views · 4 Likes

Introduction to SparkSession

We go over how to use this new feature of Apache Spark 2.0, covering all the Scala and SQL code you'll need to get started.

December 5, 2018

by Abhishek Baranwal

· 66,355 Views · 3 Likes

Anomaly Detection With Isolation Forests Using H2O

There are multiple approaches to an unsupervised anomaly detection problem that try to exploit the differences between the properties of common and unique observations.

Updated December 3, 2018

by Martin Barus

· 13,886 Views · 4 Likes