Big Data Resources

Using Machine Learning to Automate Data Cleansing

There are stages in the data cleansing process where machine learning can not only automate workflows, but influence decisions, and achieve better results.

March 8, 2021

by Zara Ziad

· 10,414 Views · 4 Likes

Apache Kafka in a Smart City Architecture

Event streaming with Apache Kafka fits into smart city architecture for data integration and correlation in real-time, at scale, between stakeholders.

March 5, 2021

by Kai Wähner

CORE

· 32,199 Views · 13 Likes

Data Integration and ETL for Dummies (Like Me)

How to understand modern data integration and ETL from a non-technical perspective.

March 4, 2021

by David Molot

· 16,469 Views · 16 Likes

The Basics of Embedded Systems and the Internet of Things

Introduction to the elements of embedded system architectures across a wide variety of embedded applications, exploring the relationship between embedded systems and IoT.

March 3, 2021

by Jim Ledin

· 23,494 Views · 4 Likes

Use Cases for Apache Kafka in Retail

Event streaming with Apache Kafka in the retail industry facilitates real-time omnichannel, Customer 360, inventory management, recommendations, and more.

March 2, 2021

by Kai Wähner

CORE

· 7,440 Views · 9 Likes

Apache Camel Integration with Kafka

This article covers the integration of Apache Camel with Kafka, from setup to testing, with code blocks and plenty of pictures!

February 28, 2021

by Vignesh Prabhu

· 16,584 Views · 1 Like

4 Best Practices for IoT OTA Updates

Don't want to brick your devices? Read on.

Updated February 24, 2021

by François Baldassari

· 23,273 Views · 8 Likes

Predictive Modeling in Data Science

Predictive modeling is an integral tool used in the data science world — learn the five primary predictive models and how to use them properly.

Updated February 21, 2021

by Abeshek P.A

· 6,709 Views · 5 Likes

How to Become a Data Engineer: A Hype Profession or a Necessary Thing

This article will tell you how a Data Engineer helps turn pure numbers into insights and why developers should look at this direction too.

February 18, 2021

by Illia Kalchenko

· 18,982 Views · 10 Likes

Intro to Soda SQL: Open Data Testing and Monitoring

How to use Soda SQL, an open data testing, monitoring and profiling tool for data-intensive environments

Updated February 17, 2021

by Tom Baeyens

· 8,430 Views · 4 Likes

A Gentle Introduction to Event-driven Change Data Capture

How to detect, capture, and propagate changes in source databases to target systems in real-time, event-driven manner

February 16, 2021

by Dunith Dhanushka

CORE

· 3,096 Views · 4 Likes

Building a Scalable E-Commerce Data Model

Starting to outgrow small business e-commerce software? Use this as a starting point for building an e-commerce data model that’s scalable, flexible, and fast.

February 12, 2021

by James Hickey

· 6,942 Views · 6 Likes

Intro To Apache Kafka: How Kafka Works

Introduction to Apache Kafka: Learn Kafka fundamentals, including the concepts of events, topics, partitions, brokers, replication, producers, and consumers.

February 12, 2021

by Tim Berglund

· 10,755 Views · 16 Likes

Scaling Salesforce Apps Using Heroku Microservices - Part 2

Combining Salesforce with Heroku including Progressive Web Apps (PWAs), using Kafka to scale MQTT protocols, and capturing change events in near real time.

February 12, 2021

by Michael Bogan

CORE

· 8,999 Views · 2 Likes

How to Write ETL Operations in Python

Clean and transform raw data into an ingestible format using Python.

February 10, 2021

by Hassan Syyid

· 8,030 Views · 7 Likes

go-mysql-mongodb: Replicate Data From MySQL To MongoDB

This tool is relatively lightweight, and only needs to deploy one service for the synchronization of a MySQL instance to MongoDB.

February 10, 2021

by Xiang Wang

· 9,931 Views · 3 Likes

Centralized Logging for Kafka on Kubernetes With Grafana, Loki, and Promtail.

If there are multiple zookeeper and Kafka pods, a single window would be a boon for administrators. Grafana provides Loki and Promtail this functionality.

February 9, 2021

by Chandra Shekhar Pandey

· 11,807 Views · 2 Likes

Using Python for Accounting And Finance Applications

Python’s development is highly robust for Finance and FinTech applications. Python is now the third most popular programming language behind C and Java.

February 7, 2021

by Parth Barot

· 17,228 Views · 3 Likes

How to Run Apache Kafka on Windows

In this step-by-step tutorial, quickly learn how to run Apache Kafka on Windows in a Linux environment backed by WSL 2 to maximize performance and stability.

February 7, 2021

by Jim Galasyn

· 6,995 Views · 7 Likes

Making Your Data Flow Resiliently With Apache NiFi Clustering

This article discusses the challenges of transferring data into a format that is serviceable for use in analytics, and how to construct a resilient data flow.

February 5, 2021

by Brent Segner

· 9,749 Views · 5 Likes

The Latest Big Data Topics