Data Engineering Resources

In the final part, we walk through how to build a serverless Go app to monitor tweets that have been abandoned due to processing failure or consumer instance failure.

July 29, 2021

by Abhishek Gupta

CORE

· 5,440 Views · 3 Likes

Integrating ClickHouse and S3 Compatible Object Storage

S3 compatible object storage integration is now extending ClickHouse capabilities — from basic import/export to MergeTree table data functionalities.

July 29, 2021

by Alexander Zaitsev

· 14,247 Views · 2 Likes

Working With Transactions in Entity Framework Core and Entity Developer

This article presents a discussion on how we can work with transactions using Entity Framework Core and Entity Developer for data access.

July 28, 2021

by Joydip Kanjilal

CORE

· 20,707 Views · 2 Likes

Demystifying the Repository Pattern in PHP

In this article, we will talk about the Repository Pattern and how we implemented it in our Laravel application to solve a scalability problem.

July 28, 2021

by Valerio Barbera

· 9,458 Views · 4 Likes

Where Are Docker Images Stored on the Host Machine?

The Docker Images and other objects are stored inside the docker directory in the local machine depending upon the default storage driver being used by the machine

July 28, 2021

by Raunak Jain

· 11,214 Views · 1 Like

Express JS Conditional Routing: How to Route Multiple Payment Gateways

Learn how a payment gateway works, why an online dealer requires one, and how to identify the best payment gateway service to keep your online business secure.

Updated July 27, 2021

by Halian Ronaldo

· 14,047 Views · 4 Likes

A Contrived Example to Illustrate How to Track "Last Updated Timestamp" in CockroachDB

In today's "Cockroach Hour", Sean from DoorDash was the guest, and it was a really interesting session. At one point he was commenting on the absence of trig...

July 27, 2021

by Michael Goddard

· 11,409 Views · 5 Likes

Hibernate, Redis, and L2 Cache Performance

Redis is a great platform for caching. Unfortunately, free options for integrating it into Hibernate as L2 cache are lacking. Let's see if we can fix that.

July 27, 2021

by Clayton Long

· 16,016 Views · 3 Likes

Building a Database Written in Node.js From the Ground Up

Node is lightweight and scalable, allows us to develop quickly, and npm has incredible packages. Read the tutorial to find out more!

Updated July 27, 2021

by Margo McCabe

· 20,732 Views · 9 Likes

What is Neural Search?

Using Neural Networks to replace complex rules and feature engineering based search to provide more accurate and scalable search system that evolves over time.

July 27, 2021

by Pradeep Sharma

· 9,713 Views · 9 Likes

The Ultimate Engineer's Guide to Code Refactoring

Learn all about refactoring source code: the benefits, challenges, tools, and best practices, and what is the difference between refactoring and technical debt.

Updated July 27, 2021

by Cate Lawrence

CORE

· 13,471 Views · 13 Likes

Running Apache Spark on Kubernetes

This article covers using Spark on K8s to overcome dependency on cloud providers and running Apache Spark on Kubernetes.

July 26, 2021

by Ramiro Alvarez Fernandez

· 12,158 Views · 3 Likes

Avoiding Recursive Invocation on ComputeIfAbsent() in HashMap

Need help on this subject? Read this tutorial on how you can avoid Recursive Invocation in this situation and improve your effectiveness.

July 26, 2021

by A N M Bazlur Rahman

CORE

· 8,016 Views · 1 Like

Spring Boot - Tracing Micro Service Logs | Log Tracing In Microservices With Spring Cloud Sleuth

In the below video tutorial, take a closer look at Log Tracing in Microservices With Spring Cloud Sleuth.

July 26, 2021

by Ram N

· 3,891 Views · 2 Likes

13 Best Practices for Using Helm

Helm is a tool for deploying applications to Kubernetes clusters. Here are 13 best practices to help you create, operate, and upgrade applications using Helm.

July 26, 2021

by Kentaro Wakayama

· 6,450 Views · 2 Likes

Top 5 AI and Machine Learning Trends For 2022

Here are some top trends that your business should start preparing for now.

July 24, 2021

by Joydeep Bhattacharya

CORE

· 20,682 Views · 7 Likes

Kafka-Streams - Tips on How to Decrease Re-Balancing Impact for Real-Time Event Processing On Highly Loaded Topics

Need to reduce re-balancing time on Kafka consumer group during deployment and understand pitfalls of Kafka Streams? Read this article to learn about the factors that affect re-balance latency.

July 24, 2021

by Vasyl Sarzhynskyi

· 48,601 Views · 6 Likes

The Perfect SaaS Tech Stack

Learn how to create your Perfect SaaS tech stack with the best programming language and build a multi tenant architecture on AWS for your SaaS web app.

July 24, 2021

by Alfonso Valdes

· 9,261 Views · 4 Likes

Explaining Cloud Computing in Layman Terms

This post explains how cloud computing uses the internet to store, access, and secure applications, data servers, and networking hardware and software.

July 23, 2021

by Usama Amin

· 11,123 Views · 3 Likes

Next-Gen Data Pipes With Spark, Kafka and k8s

This article examines the architecture patterns and provides some sample code for the readers to implement in their own environment.

July 23, 2021

by Subhendu Dey

· 14,852 Views · 4 Likes

The Latest Data Engineering Topics