Big Data Resources

Real-Time Edge Application With Apache Pulsar

In this article, you will learn how to build edge applications using Pulsar, the challenges of developing edge applications and why Apache Pulsar is the solution.

December 18, 2021

by Tim Spann

CORE

· 27,311 Views · 4 Likes

Designing High-Volume Systems Using Event-Driven Architectures

Building cloud natively

December 14, 2021

by Ram Ravishankar

· 17,223 Views · 14 Likes

How to Securely Commission Your IoT Device

Let's dig deeper into three ways to securely commission IoT devices, how each works, and their pros and cons.

December 12, 2021

by Carsten Rhod Gregersen

· 26,099 Views · 4 Likes

Visualize your Apache Kafka Streams using the Quarkus Dev UI

December 11, 2021

by Daniel Oh

CORE

· 15,229 Views · 1 Like

Migrating from Sakila-MySQL to Couchbase - Part 3: Stored Procedures

This is part 3 of migrating from Sakila to Couchbase series. Today, we will cover stored procedures that we can implement as functions.

December 8, 2021

by Isha Kandaswamy

· 5,058 Views · 1 Like

Using Datafold to Enhance DBT for Data Observability

We’ll look at how Datafold and dbt work in tandem to bring observability and repeatability into your data quality process.

December 7, 2021

by Michael Bogan

CORE

· 9,116 Views · 1 Like

What Is LoRa IoT?

Choosing a manufacturer that can manufacture Internet of things devices with multiple protocols can make your Internet of things project progress more smoothly.

November 29, 2021

by herry petty

· 24,909 Views · 19 Likes

Building an ETL Pipeline With Airflow and ECS

Get your data flowing.

November 27, 2021

by Nikita Vasilev

· 6,873 Views · 4 Likes

How To Use SingleStore With Spark ML for Fraud Detection

In this final part of our Fraud Detection series, we’ll use Spark to build a Logistic Regression model from data stored in SingleStore.

November 25, 2021

by Akmal Chaudhri

CORE

· 8,218 Views · 2 Likes

What KPIs Measure the Success of an AI Project?

The performance of a machine learning model is first assessed based on its success rate. Then about the compatibility of this rate with business objectives.

November 17, 2021

by Ketan Parmar

· 8,664 Views · 3 Likes

Monitor Apache Kafka with Telegraf and Grafana in Azure

This article talks about monitoring Apache Kafka on Azure using Telegraf and Grafana. I will guide you on installation, setup, and running monitoring solutions.

November 16, 2021

by Praveen KG

· 7,214 Views · 2 Likes

Reporting in Microservices: How To Optimize Performance

In this article, learn about a new reporting microservice developed by Freschode to overcome reporting problems they faced.

November 15, 2021

by Karina Skrinnik

· 6,295 Views · 2 Likes

What is Data Lineage and How Can It Ensure Data Quality?

By providing a clear representation of the flow of data, a data lineage system essentially allows you to have your cake and eat it too.

November 10, 2021

by Michael Bogan

CORE

· 4,528 Views · 2 Likes

How to Use SingleStore With Spark ML for Fraud Detection

In this 3-part series of articles, we’ll see how easy it is to use the SingleStore Spark Connector and the performance benefits it provides.

November 9, 2021

by Akmal Chaudhri

CORE

· 8,325 Views · 2 Likes

Lambda Architecture is one of the most useful frameworks to design big data applications and distributed data processing systems like social network platforms.

November 5, 2021

by Phani Krishna Kollapur Gandla

· 6,203 Views · 3 Likes

Kappa Architecture is Mainstream Replacing Lambda

This blog post explores why a single real-time pipeline, called Kappa architecture, is the better fit and the role of batch processing in it without requiring Lambda.

November 3, 2021

by Kai Wähner

CORE

· 7,974 Views · 8 Likes

Confluent Kafka Installation and Demo

Learn how to insert rows to SQLite-DB and show those rows on an auto-created topic on Kafka via the JDBC-source connector.

October 26, 2021

by Ersin Gulbahar

· 6,126 Views · 3 Likes

Benchmarking AWS Graviton2 and gp3 Support for Apache Kafka

Using AWS's ACCP alongside Apache Kafka on Graviton2 instances, Kafka users can get a particularly highly performant Kafka experience

October 22, 2021

by Hendra Gunadi

· 8,388 Views · 3 Likes

Distributed Tracing With Spring-cloud-Sleuth Kafka and Zipkin

In this post, you will learn to use Spring Cloud Sleuth for distributed tracing between Spring Boot microservices and Kafka with results displayed on the Zipkin server.

October 22, 2021

by Ming Jiang

· 10,043 Views · 5 Likes

Data Fabric: What Is It and Why Do You Need It?

Data fabric is a viable strategy to help overcome the barriers that previously made it hard to access data and process it in a distributed data environment.

October 21, 2021

by John Kutay

· 6,038 Views · 2 Likes

The Latest Big Data Topics