Big Data Resources

Machine Learning and Real-Time Analytics in Apache Kafka Applications

This post explores a specific part of building an ML infrastructure: the deployment of an analytic model in a Kafka application for real-time predictions.

December 25, 2019

by Kai Wähner

CORE

· 24,590 Views · 11 Likes

Using R on Jupyter Notebook

In this article, we discuss how to install use the R programming language in Jupyter Notebook for all of your statistical analysis needs.

Updated December 23, 2019

by Jirapongse Phuriphanvichai

· 82,031 Views · 6 Likes

Implement a Counter Table in Elasticsearch

In this brief article, we discuss how to implement a counter table in Elastisearch to better understand how often features are used in our app.

Updated December 13, 2019

by Dinesh Agrawal

· 17,712 Views · 3 Likes

Hadoop Ecosystem: Hadoop Tools for Crunching Big Data

In this article, we discuss the tools and components that make up the Hadoop Ecosystem, including Hive, Spark, MapReduce, ZooKeeper, and Oozie.

December 11, 2019

by Shubham Sinha

· 30,000 Views · 7 Likes

KSQL: A SQL Streaming Engine for Apache Kafka

In this article, we discuss how to use KSQL, a SQL streaming engine for Apache Kafka, to write more scalable, elastic, and fault-tolerant code.

December 11, 2019

by Shubham Dangare

· 21,408 Views · 8 Likes

Spring Cloud Streams ETL

Check out how o use Spring Cloud Streams for real-time data processing.

December 11, 2019

by imran raza

· 13,186 Views · 4 Likes

Apache Kafka as Digital Twin in Industrial IoT (IIoT)

Learn more about the benefits of Digital Twin tech in IIoT and it's relation to Apache Kafka!

December 9, 2019

by Kai Wähner

CORE

· 25,196 Views · 17 Likes

Introduction to Event Streaming with Kafka and Kafdrop

In this article, we discuss fundamental concepts behind event streaming in Apache Kafka by diving into Kafdrop's web UI.

December 4, 2019

by Emil Koutanov

· 26,695 Views · 7 Likes

Change Data Capture (CDC) With Embedded Debezium and Spring Boot

In this article, we discuss how to perform Change Data Capture with Embedded Debezium and SpringBoot as an alternative to Kafka Connect.

December 3, 2019

by Sohan Ganapathy

· 34,441 Views · 11 Likes

How to Integrate Arduino and Google Cloud Platform

Learn more about integrating Arduino and GCP in this beginner tutorial!

December 2, 2019

by Francesco Azzola

· 38,328 Views · 5 Likes

How Will AI Impact Machine Design?

In tis article, explore some of the ways that AI will impact machine design.

December 2, 2019

by Megan Nichols

· 5,383 Views · 3 Likes

The Complete Apache Spark Collection [Tutorials and Articles]

We've compiled our best tutorials and articles on one of the most popular analytics engines for data processing, Apache Spark.

December 2, 2019

by Peter Connelly

· 59,305 Views · 27 Likes

Eye Disease Detection Using TensorFlow and Azure's CustomVision.ai

Explore an AI-based system that uses the Azure Cognitive Services CustomVision tool to predict the probability of the existence of eye diseases.

November 29, 2019

by Raghu N T

· 7,586 Views · 2 Likes

Kafka Administration and Monitoring UI Tools

In this article, we review three administrative and monitoring UI tools for Kafka, including Kafka Tool, Kafka Manager, and Kafdrop.

November 28, 2019

by Guy Shilo

· 131,278 Views · 9 Likes

How to Do a Snowflake Query Pushdown in Talend

In this article, see how Talend leverages Snowflake query pushdown via ELT.

November 27, 2019

by Rekha Sree

· 16,384 Views · 2 Likes

Exploring Apache NiFi 1.10: Parameters and Stateless Engine

In this article, we discuss the new version of Apache NiFi and how to use two of the biggest new features: parameters and stateless.

November 26, 2019

by Tim Spann

CORE

· 29,543 Views · 4 Likes

Learn about publish-subscribe communication using Apache Kafka as messaging systems and validated through integration testing.

November 25, 2019

by Jailson Evora

· 37,151 Views · 11 Likes

The Complete Data Science LinkedIn Profile Guide

In this article, a Data Science recruiter discusses best-practices for marketing yourself on LinkedIn to become competitive in today's job market.

Updated November 21, 2019

by Matthew Reaney

· 39,392 Views · 3 Likes

Raspberry Pi IoT: Sensors, InfluxDB, MQTT, and Grafana

Learn how to build a dashboard based on Grafana that visualizes data acquired by sensors.

November 21, 2019

by Francesco Azzola

· 93,409 Views · 23 Likes

Understanding Principal Component Analysis (PCA)

This article will help you understand the concepts behind dimensionality reduction and how it can be used to deal with high dimensional data.

November 20, 2019

by Zulaikha Geer

· 14,764 Views · 2 Likes

The Latest Big Data Topics