Data Engineering Resources

Rust and ScyllaDB NoSQL: 3 Ways to Improve Performance

Learn how prepared statements, paging, and retries can improve performance in applications that use the ScyllaDB Rust driver through a ScyllaDB example.

September 21, 2022

by Guy Shtub

· 4,109 Views · 2 Likes

How a Background Remover Is Born

A walkthrough to making an app remove backgrounds.

September 21, 2022

by Jackson Jiang

CORE

· 4,309 Views · 1 Like

How I Found a Go Issue on ARM that Crashed the Database Server

A distributed database like TiDB is a very complex project. Its performance depends on multiple factors. I will share a peculiar Go bug that caused TiDB to crash on ARM.

September 21, 2022

by Arthur Mao

· 4,025 Views · 1 Like

Comparing Two Arrays Using Dataweave

One such thing we often encounter is comparing two arrays and finding the differences. Let's check out the different scenarios and see how we can achieve them.

September 21, 2022

by Raviteja Anumalasetty

· 10,573 Views · 3 Likes

Using Pixie to Monitor Strimzi Clusters and Kafka Applications

In this article, we'll explore an example of how eBPF allows monitoring of complex distributed systems in new ways.

September 21, 2022

by Anton Rodriguez

· 4,719 Views · 1 Like

Real-Time Streaming ETL Using Apache Kafka, Kafka Connect, Debezium, and ksqlDB

Clarify why we need to transfer data from one point to another, look at traditional approaches, and describe how to build a real-time streaming ETL process.

September 21, 2022

by Dursun Koç

CORE

· 6,302 Views · 2 Likes

CockroachDB Multi-Region Abstractions for MongoDB Developers With FerretDB

This is yet another part of an interesting experiment with FerretDB and CockroachDB. This time, we're going to expand on the previous articles by looking at the multi-region capabilities in CockroachDB.

September 21, 2022

by Artem Ervits

CORE

· 3,486 Views · 1 Like

How to Secure Your APIs

APIs are an integral part of digital business strategy today. As such, you must ensure your APIs are secure for your business and others who access them.

September 21, 2022

by Tom Smith

CORE

· 6,137 Views · 1 Like

Advanced Maintenance of a Multi-Database Citus Cluster With Flyway

This post has provided an in-depth guide on how to organize the maintenance of a Citus cluster with Flyway, including common practices, pitfalls, and workarounds.

September 21, 2022

by Ivan Vyazmitnov

· 3,679 Views · 1 Like

The 5 Most Pivotal and Innovative Additions to OpenJDK 19

OpenJDK 19 is a significant release that includes several game-changing features that will alter the Java landscape. Let's break down the five most intriguing.

September 21, 2022

by A N M Bazlur Rahman

CORE

· 7,574 Views · 5 Likes

Elasticsearch TLS Activation: X-Pack Security

In this article, learn more about what the Elasticsearch TLS structure is used to ensure, and also how to activate the x-pack-security module.

September 21, 2022

by Omer Yilmaz

CORE

· 5,541 Views · 1 Like

Top Challenges in Data Mesh and How a Data Product Platform Resolves Them

This article discusses the top 3 challenges in Data Mesh and how the mesh approach coupled with the Data Product Platform can solve your data management challenges.

Updated September 21, 2022

by Ian Tick

· 4,487 Views · 1 Like

The Importance of Purpose-Built Embedded Analytics Software

Purpose-built embedded analytics is critical to data-driven transformation because it enables employees to answer business questions and improve outcomes intelligently.

September 21, 2022

by Casey McGuigan

· 3,557 Views · 1 Like

Manage Redis on AWS From Kubernetes

In this blog post, you will learn how to use ACK with Amazon EKS for creating a Redis cluster on AWS (with Amazon MemoryDB).

Updated September 21, 2022

by Abhishek Gupta

CORE

· 29,660 Views · 5 Likes

Non-blocking Database Migrations

Learn more about data base migrations and dealing with large data.

September 20, 2022

by Aleksei Kankov

· 4,498 Views · 4 Likes

Lessons Learned From Programming at Google With Hyrum Wright and Titus Winters

In this interview, listen to Google senior staff engineers discuss their careers and give advice on how to run your software engineering team.

September 20, 2022

by Dan Lines

CORE

· 4,993 Views · 1 Like

How to Use SQL to Analyze and Visualize Data?

In this blog, we tell you how best to use SQL to analyze and visualize your data while making use of PostgreSQL and a SQL client.

September 20, 2022

by Bonnie !

· 3,322 Views · 1 Like

Develop a Simple App: React, GraphQL, Spring Data JPA, UCP, and Oracle

Develop a simple app in minutes with a React frontend that makes GraphQL calls against a Spring Boot Data JPA service backed by Oracle database and accessed via UCP.

September 20, 2022

by Paul Parkinson

· 7,616 Views · 2 Likes

Database Automation with JOOQ

This article will look at how we can automate database interaction in End 2 End automation using the JOOQ library in Java.

September 20, 2022

by Ravi Kumar

· 3,091 Views · 1 Like

Introduction to NVIDIA NeMo — Tutorial and Example

This article, we will show you how to run an actual natural language processing model using NVIDIA Nemo.

September 20, 2022

by Kevin Vu

· 6,330 Views · 2 Likes

The Latest Data Engineering Topics