Data Engineering Resources

Four Ways to Filter a Large-Sized Spark Dataset Against a Data Collection

Filtering a Spark Dataset against a collection of data values is a commonly encountered use case for many data analytics scenarios. This article explains four different ways to achieve the same.

November 6, 2020

by Ajay Gupta

· 9,340 Views · 2 Likes

How HashMap Works Internally in Java

Take a look at this article that explains how Hashmap works in Java, including how it calculates the index of a bucket and how other internals work.

Updated November 6, 2020

by Shubham Bansal

· 102,656 Views · 11 Likes

Enhanced DynamoDB Client — Java Abstraction Code

I have created a Helper code, which takes a java object and seamlessly executes the transaction onto DynamoDb.

November 5, 2020

by Gaurav Gupta

· 11,698 Views · 2 Likes

[Part 2] Mule 4: Using SSL/TLS

This is the second part of the series in learning how to configure the Mule Application to use One Way SSL and Two Way SSL.

November 5, 2020

by Ruchi Saini

· 22,162 Views · 4 Likes

Change Data Capture From PostgreSQL to Azure Data Explorer Using Kafka Connect

In this article, look at change data capture from PostgreSQL to Azure Data Explorer using Kafka Connect.

November 4, 2020

by Abhishek Gupta

CORE

· 7,826 Views · 4 Likes

Kafka Monitoring via Prometheus-Grafana

In this article, take a look at Kafka monitoring via Prometheus-Grfana.

November 4, 2020

by Murat Derman

· 36,506 Views · 4 Likes

Testing Jedis API Using Junit Test Case in Eclipse IDE

In this article, we will learn how to set up a Junit testing environment for testing Jedis API, which will interact with the Redis database.

November 4, 2020

by Tiruvenkatasamy Baskaran

· 8,232 Views · 2 Likes

Micronaut With Relation Database and...Tests

This article is a Micronauts HTTP server with a relation database persistence layer. We created this focussing on the tests at the controller layer.

November 4, 2020

by Manel Naspreda

· 11,707 Views · 4 Likes

Automated Testing: When to Start?

The main problem with automation testing is unknowledgeable, which test cases to automate and on which stage to implement automation testing.

November 4, 2020

by Anastasia Radkovska

· 9,201 Views · 2 Likes

An Introduction to Red Hat OpenShift CodeReady Containers

Getting started with CodeReady Containers — for everyone who has at least a basic understanding of the command line within PowerShell on Windows.

November 4, 2020

by Groep Zes

· 13,590 Views · 3 Likes

Resilient Microservice Design – Bulkhead Pattern

The ability of the system to recover from the failure and remain functional makes the system more resilient. It also avoids any cascading failures.

November 4, 2020

by Vinoth Selvaraj

· 44,802 Views · 24 Likes

Pulsar vs Kafka — Comparison and Myths Explored

Pros and cons, popular myths, and non-technical criteria of both Open Source Frameworks

Updated November 4, 2020

by Kai Wähner

CORE

· 14,340 Views · 8 Likes

Ports and Adapters Architecture with Kafka, Avro, and Spring-Boot

In this post, we will be implementing a Kafka Producer and Consumer using the Ports and Adapters (a.k.a. Hexagonal) architecture in a multi-module Maven project.

November 3, 2020

by Purnima Jain

· 13,439 Views · 4 Likes