Big Data Resources

Error Handling via Dead Letter Queue in Apache Kafka

Dead Letter Queue for error handling in Apache Kafka: Alternatives, best practices, and case studies from Uber and Crowdstrike.

September 3, 2022

by Kai Wähner

CORE

· 8,587 Views · 7 Likes

Blockchain Case Using Kubernetes

This article shows how we used Kubernetes and microservices architecture to build a crypto solution with complex functionality.

September 1, 2022

by Tetiana Stoyko

· 7,173 Views · 1 Like

Importance of Kubernetes in IoT Applications

With Kubernetes, development teams can quickly validate, roll out, and deploy changes to loT services.

August 25, 2022

by Vidushi Gupta

· 5,459 Views · 2 Likes

CarePet Tutorial: An Example IoT Use Case with Go and ScyllaDB

Create an IoT app from scratch with Go and configure it to use ScyllaDB NoSQL as the backend datastore.

August 24, 2022

by Guy Shtub

· 6,871 Views · 3 Likes

On Some Aspects of Big Data Processing in Apache Spark, Part 4: Versatile JSON and YAML Parsers

In this post, I present versatile JSON and YAML parsers for a Spark application.

August 23, 2022

by Alexander Eleseev

CORE

· 6,291 Views · 2 Likes

On Some Aspects of Big Data Processing in Apache Spark, Part 3: How To Deal With Malformed Data?

In this post I present some solutions on how to deal with malformed date/time data, and on how to set a default value for malformed data.

August 23, 2022

by Alexander Eleseev

CORE

· 5,506 Views · 2 Likes

How to Plant the Right Cybersecurity Seeds to Create Opportunities in IoT

This article explains how the latest security best practices offer opportunities in the IoT landscape within the limits of trust and reliability.

August 23, 2022

by Deepak Gupta

· 6,706 Views · 1 Like

Building a Data Pipeline Using QuestDB and Confluent Kafka

Let's dive into a tutorial on how to build a data pipeline using Confluent Kafka, QuestDB, and Python.

August 23, 2022

by Sooter Saalu

· 6,185 Views · 1 Like

Feature Store - Why Do You Need One?

How to set up a data architecture that saves your data scientists time and effort.

August 22, 2022

by Roger Oriol

· 5,225 Views · 1 Like

Data Pipeline Orchestration

In this article, I share an idea of what a data pipeline orchestration model might look like.

August 22, 2022

by Ivan Nikitsenka

· 7,575 Views · 2 Likes

Bootstrap K3S Data: For Beginners

Let’s take a look at how to create an initially well created cluster for managing bootstrap data with a description of K3S and High availability (HA) clusters.

Updated August 21, 2022

by Hrittik Roy

· 8,739 Views · 2 Likes

Kubernetes: Persistent Disk or StatefulSet?

When and why to use Persistent Disk and StatefulSet with Kubernetes

August 21, 2022

by Sylvain Kalache

· 5,213 Views · 1 Like

Optimal Transport and its Applications to Fairness

As fairness in AI becomes an increasing area of focus across industries, data scientists should consider the value of optimal transport

August 21, 2022

by Terrence Alsup

· 7,883 Views · 2 Likes

How to Debug an Unresponsive Elasticsearch Cluster

While highly scalable, Elastisearch is complex to set up. Read on for a cheat sheet for common integration issues, what they mean, and how to solve them.

August 21, 2022

by Derric Gilling

CORE

· 6,844 Views · 2 Likes

CHAR vs. VARCHAR: What's the Difference?

In this article, we are going to go through the similarities and differences between two MySQL data types: VARCHAR and CHAR.

August 21, 2022

by Lukas Vileikis

· 6,389 Views · 2 Likes

A Review of Popular IoT Communication Protocols

Every IoT communication protocol has a set of parameters that make it a success in one Internet of Things deployment and a total failure in another.

August 19, 2022

by Roman Lapa

· 6,627 Views · 4 Likes

How Pro-Coders and Low-Coders Can Find Common Ground

Pro-coders and low-coders can work together if each recognizes the unique talents and skills the other brings to enterprises.

August 19, 2022

by Amy Groden-Morrison

· 5,253 Views · 2 Likes

Processing of Streaming Data: Kappa vs Lambda Architectures

In today’s Big Data landscape, Lambda architecture is a new archetype for handling a vast amount of data. How does it compare to Kappa architecture?

August 19, 2022

by Gautam Goswami

CORE

· 6,308 Views · 1 Like

Integrate Oracle Database With Apache Kafka Using Debezium

Oracle Databases are used for traditional enterprise applications and departmental systems in large enterprises. Debezium connector for Oracle is a great way to capture data changes from the transactional system of record and make them available for application use.

August 16, 2022

by Hugo Guerrero

CORE

· 8,054 Views · 1 Like

On Some Aspects of Big Data Processing in Apache Spark, Part 2: Useful Design Patterns

In this post, learn to construct Spark applications in a maintainable and upgradable way, where at the same time "task not serializable" exceptions are avoided.

August 16, 2022

by Alexander Eleseev

CORE

· 9,853 Views · 5 Likes

The Latest Big Data Topics