Data Engineering Resources

Synchronized was revolutionary and still has great uses. But it's time to move to newer thread primitives and, potentially, rethink our core logic.

April 12, 2023

by Shai Almog

CORE

· 8,610 Views · 9 Likes

Must-Have Tool for Anonymous Virtual Livestreams

Virtual characters allow live streamers to interact anonymously within an app. Learn how live streamers can incorporate the human body occlusion capability.

April 12, 2023

by Jackson Jiang

· 2,905 Views · 1 Like

Using CockroachDB CDC With Apache Pulsar

As of this writing, CockroachDB does not have a direct integration with Apache Pulsar. Here, integrate CockroachDB CDC with Pulsar via the existing Kafka sink.

April 12, 2023

by Artem Ervits

CORE

· 8,971 Views · 3 Likes

Balancing Shift Left and Shift Right in Your DevOps Strategy

Both Shift Left and Shift Right are important approaches in DevOps. Here, we’ll discuss the differences between Shift Left and Shift Right.

April 12, 2023

by Ruchita Varma

· 7,385 Views · 5 Likes

5 NAS Backup Strategies: Pros and Cons Explained

In this article, we explain the NAS backup definition, reasons to have a data protection strategy, and five main strategies to back up NAS devices.

April 12, 2023

by Alex Tray

· 3,312 Views · 1 Like

How to Build a URL Shortener Web App With Flask Framework

With the rapid growth in technology, URLs are generated to create a unique form of each URL by the URLs generator's APIs.

April 11, 2023

by Joseph owino

· 8,250 Views · 8 Likes

Building an Optimized Data Pipeline on Azure Using Spark, Data Factory, Databricks, and Synapse Analytics

This article will explore how Apache Spark, Azure Data Factory, Databricks, and Synapse Analytics can be used together to create an optimized data pipeline in the cloud.

April 11, 2023

by Amlan Patnaik

· 6,424 Views · 3 Likes

Johnston Harris: “QA Is the Wild West Today, and We Turn Cowboys Into Sheriffs”

How to test only what matters and bring QA and development teams back together.

April 11, 2023

by Sasha Baglai

· 3,133 Views · 2 Likes

.NET on AWS – Persisting Application Data to S3 (Part 1)

In this post, we will create an S3 bucket and .NET solution and configure the wiring between them for application data persistence.

April 11, 2023

by Jawad Hasan Shani

CORE

· 4,114 Views · 1 Like

Rolling Numbers Animation Using Only CALayers

RollingNumbers is a lightweight UIView for getting smooth rolling animation between numbers implemented using only CALayer.

April 11, 2023

by Max Kalik

· 4,787 Views · 2 Likes

Lessons Learned From Picking a Java Driver for Amazon ElastiCache for Redis - Part 2

In this post, I’ll share some of the lessons learned from switching to Lettuce as the driver for our Java-based application.

April 11, 2023

by Jeroen Reijn

CORE

· 3,788 Views · 2 Likes

What Are Microservices Architecture and How Do They Work?

This blog provides a brief introduction to microservices architecture and how it works. It also explains how microservices are different from traditional architecture.

April 11, 2023

by Daryus Aden

· 9,102 Views · 3 Likes

Handling Bad Messages via DLQ by Configuring JDBC Kafka Sink Connector

When an error occurs, or bad data is encountered by the JDBC Kafka sink connector, these unprocessed messages are forwarded to the DLQ.

April 11, 2023

by Gautam Goswami

CORE

· 5,466 Views · 1 Like

Private DNS Zone With Azure HDInsight Kafka

This article presents a comprehensive guide to integrating Azure Private DNS with HDInsight Kafka Cluster.

April 11, 2023

by Prakashkumar Patel

· 4,677 Views · 1 Like

Streaming in Mule 4: Processing Large Data Sets

The fundamental task of MuleSoft is to integrate different systems. We will explore leveraging Streaming in Mule 4 to process large datasets.

April 11, 2023

by Ishalveer Singh Randhawa

· 16,613 Views · 1 Like

Data Modernization Stages and Best Practices

Stay ahead of the curve and unlock the full potential of your data by understanding the stages and strategic significance of data modernization.

April 11, 2023

by Tejas Kaneriya

· 4,911 Views · 1 Like

Team Mentoring and Learning Path

Continuous learning and training are vital to preparing your workforce for new challenges. It will benefit both organization and the individual.

April 11, 2023

by Lokesh Raj

· 4,561 Views · 1 Like

API Governance: Best Practices and Strategies for Effective API Management

A well-designed API governance framework helps organizations to establish guidelines and best practices for developing, deploying, and managing APIs.

April 10, 2023

by Venkata Thota

· 9,219 Views · 8 Likes

Cypress vs. Playwright: Which Is the Best Testing Tool?

This article will assist you in understanding the tools when you have to choose between Cypress Or Playwright.

April 10, 2023

by Kailash Pathak

CORE

· 6,496 Views · 5 Likes

A New Era of Data Analytics: Exploring the Innovative World of Data Lakehouse Architectures

This article delves into the intricacies of Data Lakehouse architectures and their transformative potential for addressing data management and analytics challenges.

April 10, 2023

by Andrey Gusarov

· 9,823 Views · 5 Likes

The Latest Data Engineering Topics