Big Data Resources

Kappa Architecture is Mainstream Replacing Lambda

This blog post explores why a single real-time pipeline, called Kappa architecture, is the better fit and the role of batch processing in it without requiring Lambda.

November 3, 2021

by Kai Wähner

CORE

· 8,107 Views · 8 Likes

Confluent Kafka Installation and Demo

Learn how to insert rows to SQLite-DB and show those rows on an auto-created topic on Kafka via the JDBC-source connector.

October 26, 2021

by Ersin Gulbahar

· 6,192 Views · 3 Likes

Benchmarking AWS Graviton2 and gp3 Support for Apache Kafka

Using AWS's ACCP alongside Apache Kafka on Graviton2 instances, Kafka users can get a particularly highly performant Kafka experience

October 22, 2021

by Hendra Gunadi

· 8,533 Views · 3 Likes

Distributed Tracing With Spring-cloud-Sleuth Kafka and Zipkin

In this post, you will learn to use Spring Cloud Sleuth for distributed tracing between Spring Boot microservices and Kafka with results displayed on the Zipkin server.

October 22, 2021

by Ming Jiang

· 10,117 Views · 5 Likes

Data Fabric: What Is It and Why Do You Need It?

Data fabric is a viable strategy to help overcome the barriers that previously made it hard to access data and process it in a distributed data environment.

October 21, 2021

by John Kutay

· 6,168 Views · 2 Likes

How to Accelerate Hyper-Automation With Industrial IoT

This article will walk you through specific areas where industrial IoT integration can help accelerate your pace of hyper-automation.

October 21, 2021

by Edward Ossawa

· 16,495 Views · 3 Likes

Data Fabric vs. Data Lake: Operational Comparison

In this article, we will focus on which is the most appropriate big data store for high-scale, real-time, operational use cases – data fabric vs data lake.

October 21, 2021

by Ian Tick

· 9,986 Views · 3 Likes

How To Get Closer to Consistency in Microservice Architecture

Some scenarios in microservice-based architecture involve multiple microservices. Read how completion of the scenario depends on the task completion of each microservice.

October 20, 2021

by Reza Ganji

CORE

· 10,539 Views · 10 Likes

Data Versioning 101

Data versioning makes it easy for data consumers to repeat a process or research, compare outputs as a result of using different data versions.

October 20, 2021

by Ogundiran Ayobami

· 8,309 Views · 4 Likes

Building a Real-Time Data Warehouse With TiDB and Pravega

After researching the databases and storage systems on the market, we found a more efficient and accurate real-time data warehouse solution: Pravega + TiDB.

October 20, 2021

by Tianyi Wang

· 8,850 Views · 4 Likes

Run Hundreds of Experiments with OpenCV and Hydra

In this tutorial, we'll cover how to run multiple OpenCV feature matching tasks using Hydra

October 17, 2021

by Emil Bogomolov

· 11,259 Views · 4 Likes

Cloud Data Warehouse Comparison: Redshift vs. BigQuery vs. Azure vs. Snowflake for Real-Time Workloads

We cover the pros and cons of each of these options and dive into the factors you’ll need to consider when choosing a cloud data warehouse.

Updated October 16, 2021

by Mariana Park

· 20,852 Views · 11 Likes

What Is Categorical Data and How To Identify Them

In data science, categorical data can be considered the most usable data type. In this article, we’ll explore categorical data, types, and how to identify them.

October 13, 2021

by Billy Peterson

· 4,694 Views · 2 Likes

Essential Engineering Skills For Every Software Architect

Learn eight categories of engineering craft classifications that will help you grow as a software architect to develop depth in selected areas and awareness of others.

October 12, 2021

by Ankur Kumar

· 11,590 Views · 11 Likes

Data Governance — A QuickStart With Azure Purview

Using Data effectively is incomplete without the term data governance. Here’s every “Why? How? Where?” you need to know about Data governance and Azure Purview.

October 12, 2021

by Gaurav Agarwaal

· 5,965 Views · 2 Likes

10 Best Free Udemy Courses to Learn Python Online

In this article, we discuss free Udemy courses to learn Python Programming from scratch as well as some essential Python libraries and Frameworks like Django.

Updated October 11, 2021

by Javin Paul

· 51,867 Views · 12 Likes

Enabling Change Data Capture (CDC) With Solace and StreamSets

CDC is quite the buzz these days. I have been in many client meetings where it has come up lately. So what is CDC and why might you be interested in it?

October 11, 2021

by Himanshu Gupta

· 6,197 Views · 3 Likes

Data Platform: Building an Enterprise CDC Solution

Learn how to design and build a change data capture solution.

October 10, 2021

by Miguel Garcia

CORE

· 10,057 Views · 4 Likes

KubeMQ: A Modern Alternative to Kafka

This article introduces a modern, Kubernetes-native message queue called KubeMQ, to show how organizations trying to implement Kafka on Kubernetes can benefit from it.

October 6, 2021

by Michael Bogan

CORE

· 48,515 Views · 14 Likes

AutoML: Using Auto-Sklearn and Auto-PyTorch

Get started with AutoML!

October 2, 2021

by Kevin Vu

· 16,910 Views · 3 Likes

The Latest Big Data Topics