Data Engineering Resources

CockroachDB CDC With Hadoop Ozone S3 Gateway and Docker Compose - Part 4

This is the fourth tutorial post on CockroachDB and Docker Compose. Today, we'll evaluate the Hadoop Ozone object store for CockroachDB object-store sink viability.

January 4, 2022

by Artem Ervits

CORE

· 5,381 Views · 3 Likes

The Ultimate Code Quality Checklist

Code review is a complicated process, and every company must follow a code review checklist before conducting one.

January 4, 2022

by Alex Duecode

· 9,728 Views · 10 Likes

Distributing a Java Command-Line Application

In this article, I'll show you how to package and distribute a java command-line application and the challenges one has to face to implement it.

January 4, 2022

by Loïc Rouchon

· 11,438 Views · 7 Likes

Apache Kafka as Cloud-Native iPaaS Integration Middleware

This post explores why Apache Kafka is the new black for integration projects, how it fits cloud-native iPaaS solutions, and why event streaming is a new software category.

January 4, 2022

by Kai Wähner

CORE

· 6,417 Views · 5 Likes

Snowflake Data Processing With Snowpark DataFrames

Snowpark is a new developer library in Snowflake that provides an API to process data using programming languages like Scala (and later on Java or Python), instead of SQL.

January 4, 2022

by Istvan Szegedi

· 15,916 Views · 5 Likes

Micro-Frontend Architecture

The goal of this architecture is to see web applications as a composition of functionalities where each one is worked by independent teams.

January 4, 2022

by Arnau Gris

· 9,256 Views · 15 Likes

Three Easy Ways to Run Kafka Without Zookeeper

Since version 2.8, we now can run a Kafka cluster without Zookeeper. This article will go over three easy ways to get started with a single node cluster using containers.

January 4, 2022

by Hugo Guerrero

CORE

· 7,683 Views · 4 Likes

The Role of AR/VR in Transforming the Manufacturing Industry Digitally

In this article, find out how the manufacturing industry is adopting AR and VR to transform the way it operates, and therefore overcoming several challenges.

January 4, 2022

by Sandeep Gundla

· 4,448 Views · 2 Likes

How to Generate Customer Success Analytics in Snowflake

Here's a quick demonstration on how to generate quick insights on customer success data in Snowflake using the platform Datameer.

January 3, 2022

by Jason Scharf

· 5,456 Views · 5 Likes

Everything You Need to Know About AWS Graviton2

Here's everything you need to know about AWS Graviton2, including how it compares to other processors and what migrating your workload entails.

January 3, 2022

by Ned Hallett

· 5,413 Views · 4 Likes

How To Utilize NoSQL DB: Graph Database Examples

With the rising popularity of NoSQL databases among developers, read this post to explore their possibilities, with the focus on Graph Database utilization.

January 3, 2022

by Tetiana Stoyko

· 4,214 Views · 2 Likes

SerpApi YouTube Data Extraction Tool

YouTube data has become a major part of machine learning and data analytics. Here's how to use SerpApi to extract YouTube data and query it for analysis.

January 3, 2022

by Charles Mabwa

· 1,543 Views · 3 Likes

Chef Inspec Configuration Steps

Chef InSpec is an open-source testing framework used to test or validate configurations. Here's how to configure Chef Inspec in your local system.

January 3, 2022

by Aki Ramanjaneyulu

· 8,330 Views · 2 Likes

Deploying a Scala API on OpenShift With OpenShift Pipelines

In this article, gain knowledge about how to deploy a simple API on OpenShift using the Pipelines feature, and how to build it using the Scala build tool.

January 3, 2022

by Raffael Mendes

· 6,093 Views · 2 Likes

Extracting Data From Very Large XML Files With X-definition

X-definition is an open-source Java API that can be used to extract data from XML files regardless of their size. In this tutorial, see X-definition in action.

January 3, 2022

by Curt Selak

· 5,158 Views · 2 Likes

Create Lambda Layers in AWS Lambda

Do you struggle when making layers for functions? Read this article to learn the new, simple, and extremely fast way to use the amazing feature Lambda Layers.

January 3, 2022

by Mohamed Latfalla

· 4,782 Views · 3 Likes

Deploy an Application for Azure Container Registry

In this post, we'll provide an overview of the Docker container and Docker image. We'll also go through how to build and store images by using Azure Container Registry

January 3, 2022

by Hamida Rebai

· 5,376 Views · 6 Likes

Hiring Full-Stack Developers? 6 Skills To Look For in 2022

Full-stack developers are always high on demand. In this post, we have explained the most popular tech stacks developers will be hired for in 2022.

Updated January 3, 2022

by Juned Ghanchi

· 17,195 Views · 1 Like

Running CockroachDB With Docker Compose and Minio - Part 2

In this part of a series of tutorials, we're building a microservice architecture with CockroachDB writing changes in real-time to an S3 bucket in JSON format.

January 1, 2022

by Artem Ervits

CORE

· 6,808 Views · 3 Likes

The First Annual Recap From JPA Buddy

This article tells the history behind one of the most trending IntelliJ IDEA plugin - JPA Buddy. Also, it provides some insights about issues using JPA, Hibernate, Spring Data, etc.

January 1, 2022

by Aleksey Stukalov

· 7,331 Views · 6 Likes

The Latest Data Engineering Topics