Big Data Resources

Why Mutability Is Essential for Real-Time Data Analytics

Readers will learn how mutability enables updates to existing records in a data store and why it is essential for real-time analytics to better infrastructure.

September 15, 2022

by Dhruba Borthakur

· 8,517 Views · 1 Like

Disaster Recovery With Kafka Across the Edge and Hybrid Cloud

Learn about disaster recovery and resilient real-time data streaming enterprise architectures powered by Apache Kafka at the edge and hybrid multi-cloud.

September 15, 2022

by Kai Wähner

CORE

· 6,711 Views · 2 Likes

Building a Computer Vision Model Using TensorFlow

With the release of TensorFlow 2.0 and Keras library integration as the high-level API, it is easy to build and train deep learning architectures.

September 15, 2022

by Kevin Vu

· 8,273 Views · 1 Like

Thread vs Matter: An Expert Guide to IoT Protocols

Two of IoT's most useful protocols today include Thread and Matter. But what are the differences between the two?

September 12, 2022

by Carsten Rhod Gregersen

· 13,947 Views · 3 Likes

Data Warehouse vs. Data Lake vs. Data Streaming: Friends, Enemies, Frenemies?

Let's compare data warehouses vs. data lakes vs. data streaming. Are they friends, enemies, or frenemies in the modern data stack?

September 9, 2022

by Kai Wähner

CORE

· 13,412 Views · 6 Likes

Cloud Database Services Compared: AWS, Microsoft, Google, and Oracle

Running a database server is an expensive undertaking requiring a lot of effort. Managed cloud database services offer several options, but which one is best?

September 8, 2022

by Eric Goebelbecker

CORE

· 8,542 Views · 2 Likes

Data Masking: Static vs Dynamic

In this article, we'll focus on the mechanics of data masking and gloss over a massive issue: data classification -- knowing who can access what data.

September 8, 2022

by Max Tardiveau

· 5,861 Views · 2 Likes

Cloud Migration Manual: The Adjustment to SaaS Model

Moving to SaaS software is a huge step to take, and it requires deep analysis and proper process setup. This post intends to guide you on how to move to SaaS.

Updated September 6, 2022

by Tetiana Stoyko

· 8,908 Views · 3 Likes

Using the Airflow ShortCircuitOperator to Stop Bad Data from Reaching ETL Pipelines

See how to leverage the Airflow ShortCircuitOperator to create data circuit breakers to prevent bad data from reaching your data pipelines.

September 3, 2022

by Lior Gavish

· 7,615 Views · 1 Like

Error Handling via Dead Letter Queue in Apache Kafka

Dead Letter Queue for error handling in Apache Kafka: Alternatives, best practices, and case studies from Uber and Crowdstrike.

September 3, 2022

by Kai Wähner

CORE

· 8,645 Views · 7 Likes

Blockchain Case Using Kubernetes

This article shows how we used Kubernetes and microservices architecture to build a crypto solution with complex functionality.

September 1, 2022

by Tetiana Stoyko

· 7,215 Views · 1 Like

Importance of Kubernetes in IoT Applications

With Kubernetes, development teams can quickly validate, roll out, and deploy changes to loT services.

August 25, 2022

by Vidushi Gupta

· 5,496 Views · 2 Likes

CarePet Tutorial: An Example IoT Use Case with Go and ScyllaDB

Create an IoT app from scratch with Go and configure it to use ScyllaDB NoSQL as the backend datastore.

August 24, 2022

by Guy Shtub

· 6,911 Views · 3 Likes

On Some Aspects of Big Data Processing in Apache Spark, Part 4: Versatile JSON and YAML Parsers

In this post, I present versatile JSON and YAML parsers for a Spark application.

August 23, 2022

by Alexander Eleseev

CORE

· 6,357 Views · 2 Likes

On Some Aspects of Big Data Processing in Apache Spark, Part 3: How To Deal With Malformed Data?

In this post I present some solutions on how to deal with malformed date/time data, and on how to set a default value for malformed data.

August 23, 2022

by Alexander Eleseev

CORE

· 5,556 Views · 2 Likes

How to Plant the Right Cybersecurity Seeds to Create Opportunities in IoT

This article explains how the latest security best practices offer opportunities in the IoT landscape within the limits of trust and reliability.

August 23, 2022

by Deepak Gupta

· 6,762 Views · 1 Like

Building a Data Pipeline Using QuestDB and Confluent Kafka

Let's dive into a tutorial on how to build a data pipeline using Confluent Kafka, QuestDB, and Python.

August 23, 2022

by Sooter Saalu

· 6,276 Views · 1 Like

Feature Store - Why Do You Need One?

How to set up a data architecture that saves your data scientists time and effort.

August 22, 2022

by Roger Oriol

· 5,253 Views · 1 Like

Data Pipeline Orchestration

In this article, I share an idea of what a data pipeline orchestration model might look like.

August 22, 2022

by Ivan Nikitsenka

· 7,630 Views · 2 Likes

Bootstrap K3S Data: For Beginners

Let’s take a look at how to create an initially well created cluster for managing bootstrap data with a description of K3S and High availability (HA) clusters.

Updated August 21, 2022

by Hrittik Roy

· 8,806 Views · 2 Likes

The Latest Big Data Topics