Data Engineering Resources

Lewis Prescott: “We Throw Testing Parties and Monitor Edge Case Users”

In this interview, QA-lead Lewis Prescott talks about the challenges of QA for apps used by non-tech-savvy people and more.

May 11, 2023

by Sasha Baglai

· 3,273 Views · 2 Likes

Non-Volatile Memory

In this article, we will explore the various forms of NVM, their advantages, limitations, and their potential applications.

May 11, 2023

by Aditya Bhuyan

· 3,460 Views · 2 Likes

Repeatable Database Updates via Liquibase

Tutorial on how to automatically re-run database scripts that are periodically updated without having to record them in the root migration file.

May 11, 2023

by Horatiu Dan

CORE

· 3,800 Views · 5 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 10,537 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 6,076 Views · 2 Likes

How To Build Dockerfile Faster With PVC and Docker Cache Management

Building Docker images are time-consuming. Speed up the Dockerfile build by utilizing Persistent Volume Claims (PVC) and optimizing Docker Cache management

May 11, 2023

by Prakash Kumar

· 5,646 Views · 5 Likes

GitHub Restore and Disaster Recovery: Better Get Ready

This article covers all the aspects concerning building a reliable and agile Disaster Recovery (DR) strategy.

May 11, 2023

by Greg Bak

· 4,525 Views · 2 Likes

Dynamic Data Processing Using Serverless Java With Quarkus on AWS Lambda by Enabling SnapStart (Part 2)

Learn outer loop practices in production using AWS Lambda and DynamoDB in part 2 on making serverless Java for dynamic data processing with a NoSQL database.

May 11, 2023

by Daniel Oh

CORE

· 10,117 Views · 8 Likes

How To Create a Question-Answering Model From Scratch

Building your question-answering model might seem like it could be more manageable. This tutorial will walk you through step by step to get it done.

May 10, 2023

by Joseph owino

· 6,696 Views · 4 Likes

OneStream Architecture Explained

OneStream provides an all-in-one solution that simplifies financial consolidation, planning, reporting, and analysis for businesses of all sizes.

May 10, 2023

by Sridhar Mannava

· 6,976 Views · 4 Likes

Securing Access, Encryption, and Storage Keys

Explore the fundamentals of operating and leveraging binary serialized data structures in this deep dive into effective and efficient data utilization.

May 10, 2023

by Jeroen Mulder

· 2,681 Views · 2 Likes

Using CDKTF To Create an AWS Lambda Function

Writing Infrastructure as Code (IaC). This post shows an example of creating a simple HTML form and serving it up in a Lambda function that can be accessed from a URL.

May 10, 2023

by Dale Waterworth

· 6,147 Views · 5 Likes

What Are Events? Process, Data, and Application Integrators

In EDA, Process, Data, and Application integration are indistinguishable. The key is to make "Event" the driving force for well-designed integrations.

May 10, 2023

by Cameron HUNT

· 3,438 Views · 1 Like

Why To Run Open Source Data Technologies in Your Own Cloud Account

To retain the most flexibility and portability with open-source data technology and projects, here's why you should consider a run-in-your-own-account cloud strategy.

May 10, 2023

by Anil Inamdar

· 2,644 Views · 2 Likes

Have ChatGPT Scrape Your Website

A lot of people want to have ChatGPT scrape their website. In this article, I will explain how our ChatGPT website scraper works.

May 10, 2023

by Thomas Hansen

CORE

· 3,711 Views · 3 Likes

Create and Manage Jira Sprints Like a Pro

This guide covers some theory but mostly focuses on practical tips on running Sprints in Jira. So first, let's dive into that backlog of yours!

May 10, 2023

by Oleksandr Siryi

· 4,110 Views · 2 Likes

Postgres JSON Functions With Hibernate 5

Take a look at how you can add support for the JSON functions in your project that uses Hibernate 5 and Postgres with the posjsonhelper library.

May 10, 2023

by Szymon Tarnowski

CORE

· 10,582 Views · 5 Likes

Developing Metadata-Driven Data Engineering Pipelines Using Apache Spark and Python Dictionary

This article will discuss metadata-driven programming techniques to make our PySpark code more flexible, maintainable, and reusable.

May 10, 2023

by Amlan Patnaik

· 5,913 Views · 4 Likes

Ultrafast Application Development With MicroStream and PostgreSQL Integration Using Jakarta EE

Explore the integration between MicroStream and PostgreSQL, leveraging Jakarta Data to enhance the development process and create ultrafast applications.

May 10, 2023

by Otavio Santana

CORE

· 7,605 Views · 3 Likes

Creating a Choropleth Map With JavaScript

Learn to create a choropleth map with JavaScript step by step in this tutorial, with Queen Elizabeth II's state visits as an example of data.

May 9, 2023

by Shachee Swadia

· 6,754 Views · 3 Likes

The Latest Data Engineering Topics