Data Engineering Resources

Remediating Incidents With the GitGuardian API [Cheat Sheet Included]

The GitGuardian API lets you remediate your secret incidents. We are proud to release a new demo app to help you learn how to automate your workflows.

May 12, 2023

by Dwayne McDaniel

· 5,567 Views · 1 Like

Global Supply Chain With Kafka and IoT

Transforming global supply chain with data streaming and IoT for end-to-end visibility and decision-making in real-time at BMW, Bosch, and Walmart.

May 12, 2023

by Kai Wähner

CORE

· 6,700 Views · 2 Likes

In this tutorial, we will be creating a “Live Code Sharing Platform” that allows users to share code and engage in video and audio calls.

May 12, 2023

by Vishal Pratap Singh

· 6,066 Views · 2 Likes

Cleaning Up AI-Generated Images With CodeFormer: A Complete Guide

This article offers a hands-on journey through the world of AI image restoration and clean-up with CodeFormer and Node.js.

May 12, 2023

by mike labs

· 6,131 Views · 2 Likes

How To Implement Istio Ambient Mesh in GKE or AKS

Ambient mode is the future of Istio service mesh. This article presents a step-by-step tutorial on how to implement it in GKE or AKS.

May 12, 2023

by Ravi Verma

· 7,806 Views · 7 Likes

Managing Data Residency: Concepts and Theory

Cloud computing has opened a Pandora's Box of many original issues compared to sound old on-premise systems. Here, learn about the chief issue: data residency.

May 12, 2023

by Nicolas Fränkel

· 7,007 Views · 2 Likes

Enriching Kafka Applications With Contextual Data

Kafka is great for event streaming architectures, continuous data integration (ETL), and messaging systems of record (database). Learn how to enhance your Kafka applications.

May 12, 2023

by Fawaz Ghali, PhD

CORE

· 7,276 Views · 4 Likes

Experimentation: How Data Leaders Can Generate Crystal Clear ROI

Data teams can drive quantifiable ROI by establishing a strong experimentation program. Here are the lessons we’ve learned at Airbnb and the New York Times.

May 11, 2023

by Shane Murray

· 3,416 Views · 1 Like

Lewis Prescott: “We Throw Testing Parties and Monitor Edge Case Users”

In this interview, QA-lead Lewis Prescott talks about the challenges of QA for apps used by non-tech-savvy people and more.

May 11, 2023

by Sasha Baglai

· 3,254 Views · 2 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,444 Views · 2 Likes

Repeatable Database Updates via Liquibase

Tutorial on how to automatically re-run database scripts that are periodically updated without having to record them in the root migration file.

May 11, 2023

by Horatiu Dan

CORE

· 3,781 Views · 5 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 10,440 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 6,020 Views · 2 Likes

How To Build Dockerfile Faster With PVC and Docker Cache Management

Building Docker images are time-consuming. Speed up the Dockerfile build by utilizing Persistent Volume Claims (PVC) and optimizing Docker Cache management

May 11, 2023

by Prakash Kumar

· 5,625 Views · 5 Likes

GitHub Restore and Disaster Recovery: Better Get Ready

This article covers all the aspects concerning building a reliable and agile Disaster Recovery (DR) strategy.

May 11, 2023

by Greg Bak

· 4,503 Views · 2 Likes

Dynamic Data Processing Using Serverless Java With Quarkus on AWS Lambda by Enabling SnapStart (Part 2)

Learn outer loop practices in production using AWS Lambda and DynamoDB in part 2 on making serverless Java for dynamic data processing with a NoSQL database.

May 11, 2023

by Daniel Oh

CORE

· 10,054 Views · 8 Likes

How To Create a Question-Answering Model From Scratch

Building your question-answering model might seem like it could be more manageable. This tutorial will walk you through step by step to get it done.

May 10, 2023

by Joseph owino

· 6,626 Views · 4 Likes

OneStream Architecture Explained

OneStream provides an all-in-one solution that simplifies financial consolidation, planning, reporting, and analysis for businesses of all sizes.

May 10, 2023

by Sridhar Mannava

· 6,783 Views · 3 Likes

Securing Access, Encryption, and Storage Keys

Explore the fundamentals of operating and leveraging binary serialized data structures in this deep dive into effective and efficient data utilization.

May 10, 2023

by Jeroen Mulder

· 2,657 Views · 2 Likes

Using CDKTF To Create an AWS Lambda Function

Writing Infrastructure as Code (IaC). This post shows an example of creating a simple HTML form and serving it up in a Lambda function that can be accessed from a URL.

May 10, 2023

by Dale Waterworth

· 6,106 Views · 5 Likes

The Latest Data Engineering Topics