Data Engineering Resources

Install and Configuration of Apache Hive-3.1.2 on Multi-Node

The Apache Hive is a data warehouse system built on top of the Apache Hadoop. Hive can be utilized for easy data summarization, and more!

December 2, 2020

by Gautam Goswami

CORE

· 16,716 Views · 2 Likes

Event Sourcing in .NET Core: A Gentle Introduction

In this article, we dive into theory behind Event Sourcing and how to implement it in a basic application with .NET Core.

Updated December 2, 2020

by David Guida

· 42,829 Views · 6 Likes

How to Build a Concurrent Chat App With Go and WebSockets

Just as Go makes programming such an application simple, Heroku makes it easy to supplement it with additional infrastructure.

December 1, 2020

by Michael Bogan

CORE

· 23,942 Views · 4 Likes

Practical Transaction Handling in Microservice Architecture

The challenges that arise in implementing transaction handling in microservice architectures, and possible solutions for handling them.

December 1, 2020

by Anjana Fernando

· 46,455 Views · 16 Likes

How to Geo-Partition Data in Distributed SQL

How to achieve high performance and regulatory compliance with partitioning.

December 1, 2020

by Karthik Ranganathan

· 12,025 Views · 4 Likes

Mule 4: Using API Notebooks

This article explains how to use API Notebooks.

December 1, 2020

by Ruchi Saini

· 12,870 Views · 1 Like

Debezium Serialization With Apache Avro and Apicurio Service Registry

This article demonstrates how to use Debezium to monitor a MySQL database and then use Apache Avro with the Apicurio service registry to externalize the data schema and reduce the payload of each one of the captured events.

December 1, 2020

by Hugo Guerrero

CORE

· 6,894 Views · 2 Likes

Microservices Powered By Domain-Driven Design

Difficult to model the boundaries of your system’s microservices? If answers to any or many of such questions are yes, then Domain-Driven Design aka DDD is likely to be useful to your Team!

Updated November 30, 2020

by Sandeep Jagtap

· 14,297 Views · 4 Likes

Modern Web-UI for SVN Repositories

Installing and configuring cSvn - a modern web interface written in C for Subversion repositories on your server.

November 25, 2020

by Andrey Kosteltsev

· 13,121 Views · 2 Likes

How to Use Kotlin to Create a Secure Ktor Application

In this article, see how to use a modern JVM stack to build your own Nano Blogging Service, or nabl, using Ktor.

November 25, 2020

by Ruslan Zaharov

· 14,053 Views · 4 Likes

Spring Boot and Micrometer with InfluxDB Part 2: Adding InfluxDB

Part 2 of Spring Boot and Micrometer with InfluxDB where I'll show how to add InfluxDB and add a docker instance.

November 24, 2020

by Emmanouil Gkatziouras

CORE

· 15,508 Views · 4 Likes

Setup Zookeeper Cluster – A Minute Chore

Apache Zookeeper’s functionalities are not legitimately noticeable to end-client however it remains as the spine for hyped components like Hadoop to oversee.

November 24, 2020

by Gautam Goswami

CORE

· 10,731 Views · 3 Likes

AI/ML Project Work By Using Scrum

How to apply scrum methodology to work with AI/ML product development. We go over the challenges and tips for application.

November 24, 2020

by CHANDAN LAL PATARY

· 14,804 Views · 3 Likes

How to Deploy Azure Function Apps With Powershell

Today, see a quick'n'dirty way to easily deploy your Azure Function Apps using Powershell.

November 24, 2020

by David Guida

· 11,836 Views · 3 Likes

API Testing Using Python Script

Are you trying to test API in your project without a tool? Here comes the Requests library, one of the powerful and standard libraries in Python.

November 23, 2020

by Srilakshmi Srinadhuni

· 27,676 Views · 3 Likes

Database Authentication + Spring Security SAML

In this article, take a look at database authentication plus Spring security SAML.

November 20, 2020

by Joe Cavazos

· 15,941 Views · 3 Likes

Identify and Resolve Stragglers in Your Spark Application

Know about potential stragglers in your Spark application and how they affect the overall application performance.

November 20, 2020

by Ajay Gupta

· 15,356 Views · 3 Likes

Microsoft Azure Data Lake

In this article, see how a team created a central controlled data repository with the MS Azure echo system.

Updated November 19, 2020

by Zeeshan Anwar

· 11,069 Views · 8 Likes

What Is MLOps and What Does Big Data Have To Do With It?

By analogy with DevOps and DataOps, and the growth of their practical implications, the business needs to organize continuous cooperation between participants.

November 18, 2020

by Shahmeer Khan

· 8,290 Views · 3 Likes

Getting Started With the Retry Pattern

Understanding retry pattern and use cases with sample python code

November 18, 2020

by Preetdeep Kumar

· 14,860 Views · 4 Likes

The Latest Data Engineering Topics