Big Data Resources

Kubeflow Fundamentals Part 6: Working With Jupyter Lab Notebooks

In this post, we’ll focus on getting more familiar with Jupyter notebooks and how we can leverage them within Kubeflow as part of our machine learning workflow.

January 5, 2022

by Jimmy Guerrero

· 5,291 Views · 3 Likes

Simplify Migrating From Kafka to Pulsar With Kafka Connect Support

In this article, we will discuss streaming sources that push data into Pulsar from another system and sinks that send data from Pulsar to another destination.

January 5, 2022

by Enrico Olivelli

· 5,562 Views · 3 Likes

CockroachDB CDC With Hadoop Ozone S3 Gateway and Docker Compose - Part 4

This is the fourth tutorial post on CockroachDB and Docker Compose. Today, we'll evaluate the Hadoop Ozone object store for CockroachDB object-store sink viability.

January 4, 2022

by Artem Ervits

CORE

· 5,283 Views · 3 Likes

Apache Kafka as Cloud-Native iPaaS Integration Middleware

This post explores why Apache Kafka is the new black for integration projects, how it fits cloud-native iPaaS solutions, and why event streaming is a new software category.

January 4, 2022

by Kai Wähner

CORE

· 6,279 Views · 5 Likes

Snowflake Data Processing With Snowpark DataFrames

Snowpark is a new developer library in Snowflake that provides an API to process data using programming languages like Scala (and later on Java or Python), instead of SQL.

January 4, 2022

by Istvan Szegedi

· 15,719 Views · 5 Likes

Three Easy Ways to Run Kafka Without Zookeeper

Since version 2.8, we now can run a Kafka cluster without Zookeeper. This article will go over three easy ways to get started with a single node cluster using containers.

January 4, 2022

by Hugo Guerrero

CORE

· 7,568 Views · 4 Likes

How to Generate Customer Success Analytics in Snowflake

Here's a quick demonstration on how to generate quick insights on customer success data in Snowflake using the platform Datameer.

January 3, 2022

by Jason Scharf

· 5,274 Views · 5 Likes

The First Annual Recap From JPA Buddy

This article tells the history behind one of the most trending IntelliJ IDEA plugin - JPA Buddy. Also, it provides some insights about issues using JPA, Hibernate, Spring Data, etc.

January 1, 2022

by Aleksey Stukalov

· 7,125 Views · 6 Likes

Best Practices for Transforming Data in Snowflake

Some helpful hints to get your data where and how it needs to be.

December 22, 2021

by John Morrell

· 8,673 Views · 3 Likes

Data Structures in SQL: The Definitive Guide

Data structures designate different ways of storing data on a computer. Choosing the right data structure for your data can make a tremendous impact.

December 18, 2021

by Felix Schildorfer

· 9,719 Views · 4 Likes

Real-Time Edge Application With Apache Pulsar

In this article, you will learn how to build edge applications using Pulsar, the challenges of developing edge applications and why Apache Pulsar is the solution.

December 18, 2021

by Tim Spann

CORE

· 27,363 Views · 4 Likes

Designing High-Volume Systems Using Event-Driven Architectures

Building cloud natively

December 14, 2021

by Ram Ravishankar

· 17,294 Views · 14 Likes

How to Securely Commission Your IoT Device

Let's dig deeper into three ways to securely commission IoT devices, how each works, and their pros and cons.

December 12, 2021

by Carsten Rhod Gregersen

· 26,129 Views · 4 Likes

Visualize your Apache Kafka Streams using the Quarkus Dev UI

December 11, 2021

by Daniel Oh

CORE

· 15,263 Views · 1 Like

Migrating from Sakila-MySQL to Couchbase - Part 3: Stored Procedures

This is part 3 of migrating from Sakila to Couchbase series. Today, we will cover stored procedures that we can implement as functions.

December 8, 2021

by Isha Kandaswamy

· 5,093 Views · 1 Like

Using Datafold to Enhance DBT for Data Observability

We’ll look at how Datafold and dbt work in tandem to bring observability and repeatability into your data quality process.

December 7, 2021

by Michael Bogan

CORE

· 9,160 Views · 1 Like

What Is LoRa IoT?

Choosing a manufacturer that can manufacture Internet of things devices with multiple protocols can make your Internet of things project progress more smoothly.

November 29, 2021

by herry petty

· 24,979 Views · 19 Likes

Building an ETL Pipeline With Airflow and ECS

Get your data flowing.

November 27, 2021

by Nikita Vasilev

· 6,913 Views · 4 Likes

How To Use SingleStore With Spark ML for Fraud Detection

In this final part of our Fraud Detection series, we’ll use Spark to build a Logistic Regression model from data stored in SingleStore.

November 25, 2021

by Akmal Chaudhri

CORE

· 8,244 Views · 2 Likes

What KPIs Measure the Success of an AI Project?

The performance of a machine learning model is first assessed based on its success rate. Then about the compatibility of this rate with business objectives.

November 17, 2021

by Ketan Parmar

· 8,717 Views · 3 Likes

The Latest Big Data Topics