Big Data Resources

Speed up Large-Scale ML/DL Offline Inference Jobs at Microsoft Bing

In this article, we will share our observations and the practice to solve the challenges while running inference at scale.

January 11, 2022

by Binyang Li

· 3,221 Views · 3 Likes

Streaming Data Exchange With Kafka and a Data Mesh in Motion

Data Mesh is an architecture paradigm, not a single technology. This post looks into this principle to explore why no single technology is fit to build a Data Mesh.

January 10, 2022

by Kai Wähner

CORE

· 4,440 Views · 7 Likes

Import Data From Hadoop Into CockroachDB

In this article, we are going to take a slight detour from docker compose and evaluate ingestion of data from Hadoop into CockroachDB.

January 7, 2022

by Artem Ervits

CORE

· 5,080 Views · 3 Likes

How To Use SingleStore Pipelines With Kafka, Part 1 of 3

This series of articles looks at a compelling feature of SingleStore called Pipelines. Here in Part 1, learn how to load some sensor data into SingleStore.

January 6, 2022

by Akmal Chaudhri

CORE

· 5,180 Views · 4 Likes

Demystifying Grids For Developers and Designers

UX/UI trends come and go - but one constant, and constantly overlooked, aspect of design optics today are data grids. Let's discuss why is that so?

January 6, 2022

by Sara Faatz

· 9,084 Views · 3 Likes

Kubeflow Fundamentals Part 6: Working With Jupyter Lab Notebooks

In this post, we’ll focus on getting more familiar with Jupyter notebooks and how we can leverage them within Kubeflow as part of our machine learning workflow.

January 5, 2022

by Jimmy Guerrero

· 4,964 Views · 3 Likes

Simplify Migrating From Kafka to Pulsar With Kafka Connect Support

In this article, we will discuss streaming sources that push data into Pulsar from another system and sinks that send data from Pulsar to another destination.

January 5, 2022

by Enrico Olivelli

· 4,061 Views · 3 Likes

CockroachDB CDC With Hadoop Ozone S3 Gateway and Docker Compose - Part 4

This is the fourth tutorial post on CockroachDB and Docker Compose. Today, we'll evaluate the Hadoop Ozone object store for CockroachDB object-store sink viability.

January 4, 2022

by Artem Ervits

CORE

· 4,875 Views · 3 Likes

Apache Kafka as Cloud-Native iPaaS Integration Middleware

This post explores why Apache Kafka is the new black for integration projects, how it fits cloud-native iPaaS solutions, and why event streaming is a new software category.

January 4, 2022

by Kai Wähner

CORE

· 5,671 Views · 5 Likes

Snowflake Data Processing With Snowpark DataFrames

Snowpark is a new developer library in Snowflake that provides an API to process data using programming languages like Scala (and later on Java or Python), instead of SQL.

January 4, 2022

by Istvan Szegedi

· 14,772 Views · 5 Likes

Three Easy Ways to Run Kafka Without Zookeeper

Since version 2.8, we now can run a Kafka cluster without Zookeeper. This article will go over three easy ways to get started with a single node cluster using containers.

January 4, 2022

by Hugo Guerrero

CORE

· 7,076 Views · 4 Likes

How to Generate Customer Success Analytics in Snowflake

Here's a quick demonstration on how to generate quick insights on customer success data in Snowflake using the platform Datameer.

January 3, 2022

by Jason Scharf

· 4,514 Views · 5 Likes

The First Annual Recap From JPA Buddy

This article tells the history behind one of the most trending IntelliJ IDEA plugin - JPA Buddy. Also, it provides some insights about issues using JPA, Hibernate, Spring Data, etc.

January 1, 2022

by Aleksey Stukalov

· 6,026 Views · 6 Likes

Best Practices for Transforming Data in Snowflake

Some helpful hints to get your data where and how it needs to be.

December 22, 2021

by John Morrell

· 7,799 Views · 3 Likes

Data Structures in SQL: The Definitive Guide

Data structures designate different ways of storing data on a computer. Choosing the right data structure for your data can make a tremendous impact.

December 18, 2021

by Felix Schildorfer

· 8,734 Views · 4 Likes

Real-Time Edge Application With Apache Pulsar

In this article, you will learn how to build edge applications using Pulsar, the challenges of developing edge applications and why Apache Pulsar is the solution.

December 18, 2021

by Tim Spann

CORE

· 26,633 Views · 4 Likes