Data Engineering Resources

Enriching Kafka Applications With Contextual Data

Kafka is great for event streaming architectures, continuous data integration (ETL), and messaging systems of record (database). Learn how to enhance your Kafka applications.

May 12, 2023

by Fawaz Ghali, PhD

CORE

· 6,679 Views · 4 Likes

Experimentation: How Data Leaders Can Generate Crystal Clear ROI

Data teams can drive quantifiable ROI by establishing a strong experimentation program. Here are the lessons we’ve learned at Airbnb and the New York Times.

May 11, 2023

by Shane Murray

· 3,045 Views · 1 Like

Lewis Prescott: “We Throw Testing Parties and Monitor Edge Case Users”

In this interview, QA-lead Lewis Prescott talks about the challenges of QA for apps used by non-tech-savvy people and more.

May 11, 2023

by Sasha Baglai

· 2,914 Views · 2 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,007 Views · 2 Likes

Repeatable Database Updates via Liquibase

Tutorial on how to automatically re-run database scripts that are periodically updated without having to record them in the root migration file.

May 11, 2023

by Horatiu Dan

· 3,147 Views · 2 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 8,044 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 5,199 Views · 2 Likes

How To Build Dockerfile Faster With PVC and Docker Cache Management

Building Docker images are time-consuming. Speed up the Dockerfile build by utilizing Persistent Volume Claims (PVC) and optimizing Docker Cache management

May 11, 2023

by Prakash Kumar

· 5,171 Views · 5 Likes

GitHub Restore and Disaster Recovery: Better Get Ready

This article covers all the aspects concerning building a reliable and agile Disaster Recovery (DR) strategy.

May 11, 2023

by Greg Bak

· 4,008 Views · 2 Likes

Dynamic Data Processing Using Serverless Java With Quarkus on AWS Lambda by Enabling SnapStart (Part 2)

Learn outer loop practices in production using AWS Lambda and DynamoDB in part 2 on making serverless Java for dynamic data processing with a NoSQL database.

May 11, 2023

by Daniel Oh

CORE

· 9,051 Views · 8 Likes

How To Create a Question-Answering Model From Scratch

Building your question-answering model might seem like it could be more manageable. This tutorial will walk you through step by step to get it done.

May 10, 2023

by Joseph owino

· 5,296 Views · 4 Likes

OneStream Architecture Explained

OneStream provides an all-in-one solution that simplifies financial consolidation, planning, reporting, and analysis for businesses of all sizes.

May 10, 2023

by Sridhar Mannava

· 4,227 Views · 3 Likes

Securing Access, Encryption, and Storage Keys

Explore the fundamentals of operating and leveraging binary serialized data structures in this deep dive into effective and efficient data utilization.

May 10, 2023

by Jeroen Mulder

· 2,310 Views · 2 Likes

Using CDKTF To Create an AWS Lambda Function

Writing Infrastructure as Code (IaC). This post shows an example of creating a simple HTML form and serving it up in a Lambda function that can be accessed from a URL.

May 10, 2023

by Dale Waterworth

· 5,166 Views · 5 Likes

What Are Events? Process, Data, and Application Integrators

In EDA, Process, Data, and Application integration are indistinguishable. The key is to make "Event" the driving force for well-designed integrations.

May 10, 2023

by Cameron HUNT

· 2,488 Views · 1 Like

Why To Run Open Source Data Technologies in Your Own Cloud Account

To retain the most flexibility and portability with open-source data technology and projects, here's why you should consider a run-in-your-own-account cloud strategy.

May 10, 2023

by Anil Inamdar

· 1,954 Views · 2 Likes