Data Engineering Resources

5 NAS Backup Strategies: Pros and Cons Explained

In this article, we explain the NAS backup definition, reasons to have a data protection strategy, and five main strategies to back up NAS devices.

April 12, 2023

by Alex Tray

· 3,274 Views · 1 Like

How to Build a URL Shortener Web App With Flask Framework

With the rapid growth in technology, URLs are generated to create a unique form of each URL by the URLs generator's APIs.

April 11, 2023

by Joseph owino

· 8,049 Views · 8 Likes

Building an Optimized Data Pipeline on Azure Using Spark, Data Factory, Databricks, and Synapse Analytics

This article will explore how Apache Spark, Azure Data Factory, Databricks, and Synapse Analytics can be used together to create an optimized data pipeline in the cloud.

April 11, 2023

by Amlan Patnaik

· 6,366 Views · 3 Likes

Johnston Harris: “QA Is the Wild West Today, and We Turn Cowboys Into Sheriffs”

How to test only what matters and bring QA and development teams back together.

April 11, 2023

by Sasha Baglai

· 3,106 Views · 2 Likes

.NET on AWS – Persisting Application Data to S3 (Part 1)

In this post, we will create an S3 bucket and .NET solution and configure the wiring between them for application data persistence.

April 11, 2023

by Jawad Hasan Shani

CORE

· 4,061 Views · 1 Like

Rolling Numbers Animation Using Only CALayers

RollingNumbers is a lightweight UIView for getting smooth rolling animation between numbers implemented using only CALayer.

April 11, 2023

by Max Kalik

· 4,384 Views · 2 Likes

Lessons Learned From Picking a Java Driver for Amazon ElastiCache for Redis - Part 2

In this post, I’ll share some of the lessons learned from switching to Lettuce as the driver for our Java-based application.

April 11, 2023

by Jeroen Reijn

CORE

· 3,741 Views · 2 Likes

What Are Microservices Architecture and How Do They Work?

This blog provides a brief introduction to microservices architecture and how it works. It also explains how microservices are different from traditional architecture.

April 11, 2023

by Daryus Aden

· 8,984 Views · 3 Likes

Handling Bad Messages via DLQ by Configuring JDBC Kafka Sink Connector

When an error occurs, or bad data is encountered by the JDBC Kafka sink connector, these unprocessed messages are forwarded to the DLQ.

April 11, 2023

by Gautam Goswami

CORE

· 5,432 Views · 1 Like

Private DNS Zone With Azure HDInsight Kafka

This article presents a comprehensive guide to integrating Azure Private DNS with HDInsight Kafka Cluster.

April 11, 2023

by Prakashkumar Patel

· 4,566 Views · 1 Like

Streaming in Mule 4: Processing Large Data Sets

The fundamental task of MuleSoft is to integrate different systems. We will explore leveraging Streaming in Mule 4 to process large datasets.

April 11, 2023

by Ishalveer Singh Randhawa

· 16,367 Views · 1 Like

Data Modernization Stages and Best Practices

Stay ahead of the curve and unlock the full potential of your data by understanding the stages and strategic significance of data modernization.

April 11, 2023

by Tejas Kaneriya

· 4,871 Views · 1 Like

Team Mentoring and Learning Path

Continuous learning and training are vital to preparing your workforce for new challenges. It will benefit both organization and the individual.

April 11, 2023

by Lokesh Raj

· 4,517 Views · 1 Like

API Governance: Best Practices and Strategies for Effective API Management

A well-designed API governance framework helps organizations to establish guidelines and best practices for developing, deploying, and managing APIs.

April 10, 2023

by Venkata Thota

· 9,131 Views · 8 Likes

Cypress vs. Playwright: Which Is the Best Testing Tool?

This article will assist you in understanding the tools when you have to choose between Cypress Or Playwright.

April 10, 2023

by Kailash Pathak

CORE

· 6,461 Views · 5 Likes

A New Era of Data Analytics: Exploring the Innovative World of Data Lakehouse Architectures

This article delves into the intricacies of Data Lakehouse architectures and their transformative potential for addressing data management and analytics challenges.

April 10, 2023

by Andrey Gusarov

· 9,744 Views · 5 Likes

What Is a Streaming Database?

A streaming database can help make better decisions, identify opportunities, and respond to real-time threats.

April 10, 2023

by Yingjun Wu

· 6,260 Views · 4 Likes

Okta as Code: Identity Management in the Cloud Native Era

Okta has become the de facto way to manage administrative access to digital resources, and this is why it should be managed as code, like all cloud resources.

April 10, 2023

by Eran Bibi

· 5,742 Views · 1 Like

Shaping the Future of IoT: 7 MQTT Technology Trends in 2023

We can anticipate 7 developing trends in MQTT technology, as the use of MQTT in IoT is growing tremendously.

April 8, 2023

by Zaiming (stone) Shi

· 6,567 Views · 1 Like

Steps for Developers to Take Toward Green IT

As the need for environmental sustainability increases, developers must take steps toward adopting more green IT practices.

April 7, 2023

by Devin Partida

· 5,918 Views · 1 Like

The Latest Data Engineering Topics