Data Engineering Resources

Repeatable Database Updates via Liquibase

Tutorial on how to automatically re-run database scripts that are periodically updated without having to record them in the root migration file.

May 11, 2023

by Horatiu Dan

CORE

· 3,682 Views · 5 Likes

A Deep Dive Into the Differences Between Kafka and Pulsar

Compare Apache Kafka and Pulsar, highlighting unique features and core distinctions. It aims to provide insight into mechanisms and inform decision-making.

May 11, 2023

by Teng Fu

· 10,185 Views · 8 Likes

Harnessing the Power of MQTT for the Future of IoT

As the use of MQTT in IoT is growing tremendously, we can anticipate seven developing trends in MQTT technology.

May 11, 2023

by Umar Nabi

· 5,891 Views · 2 Likes

How To Build Dockerfile Faster With PVC and Docker Cache Management

Building Docker images are time-consuming. Speed up the Dockerfile build by utilizing Persistent Volume Claims (PVC) and optimizing Docker Cache management

May 11, 2023

by Prakash Kumar

· 5,570 Views · 5 Likes

GitHub Restore and Disaster Recovery: Better Get Ready

This article covers all the aspects concerning building a reliable and agile Disaster Recovery (DR) strategy.

May 11, 2023

by Greg Bak

· 4,440 Views · 2 Likes

Dynamic Data Processing Using Serverless Java With Quarkus on AWS Lambda by Enabling SnapStart (Part 2)

Learn outer loop practices in production using AWS Lambda and DynamoDB in part 2 on making serverless Java for dynamic data processing with a NoSQL database.

May 11, 2023

by Daniel Oh

CORE

· 9,901 Views · 8 Likes

How To Create a Question-Answering Model From Scratch

Building your question-answering model might seem like it could be more manageable. This tutorial will walk you through step by step to get it done.

May 10, 2023

by Joseph owino

· 6,515 Views · 4 Likes

OneStream Architecture Explained

OneStream provides an all-in-one solution that simplifies financial consolidation, planning, reporting, and analysis for businesses of all sizes.

May 10, 2023

by Sridhar Mannava

· 6,451 Views · 3 Likes

Securing Access, Encryption, and Storage Keys

Explore the fundamentals of operating and leveraging binary serialized data structures in this deep dive into effective and efficient data utilization.

May 10, 2023

by Jeroen Mulder

· 2,597 Views · 2 Likes

Using CDKTF To Create an AWS Lambda Function

Writing Infrastructure as Code (IaC). This post shows an example of creating a simple HTML form and serving it up in a Lambda function that can be accessed from a URL.

May 10, 2023

by Dale Waterworth

· 5,986 Views · 5 Likes

What Are Events? Process, Data, and Application Integrators

In EDA, Process, Data, and Application integration are indistinguishable. The key is to make "Event" the driving force for well-designed integrations.

May 10, 2023

by Cameron HUNT

· 3,290 Views · 1 Like

Why To Run Open Source Data Technologies in Your Own Cloud Account

To retain the most flexibility and portability with open-source data technology and projects, here's why you should consider a run-in-your-own-account cloud strategy.

May 10, 2023

by Anil Inamdar

· 2,510 Views · 2 Likes

Have ChatGPT Scrape Your Website

A lot of people want to have ChatGPT scrape their website. In this article, I will explain how our ChatGPT website scraper works.

May 10, 2023

by Thomas Hansen

CORE

· 3,549 Views · 3 Likes

Create and Manage Jira Sprints Like a Pro

This guide covers some theory but mostly focuses on practical tips on running Sprints in Jira. So first, let's dive into that backlog of yours!

May 10, 2023

by Oleksandr Siryi

· 3,966 Views · 2 Likes

Postgres JSON Functions With Hibernate 5

Take a look at how you can add support for the JSON functions in your project that uses Hibernate 5 and Postgres with the posjsonhelper library.

May 10, 2023

by Szymon Tarnowski

CORE

· 10,391 Views · 5 Likes

Developing Metadata-Driven Data Engineering Pipelines Using Apache Spark and Python Dictionary

This article will discuss metadata-driven programming techniques to make our PySpark code more flexible, maintainable, and reusable.

May 10, 2023

by Amlan Patnaik

· 5,748 Views · 4 Likes

Ultrafast Application Development With MicroStream and PostgreSQL Integration Using Jakarta EE

Explore the integration between MicroStream and PostgreSQL, leveraging Jakarta Data to enhance the development process and create ultrafast applications.

May 10, 2023

by Otavio Santana

CORE

· 7,419 Views · 3 Likes

Creating a Choropleth Map With JavaScript

Learn to create a choropleth map with JavaScript step by step in this tutorial, with Queen Elizabeth II's state visits as an example of data.

May 9, 2023

by Shachee Swadia

· 6,617 Views · 3 Likes

Top Data Science Courses to Consider

In this article, we will read about the top 7 Data Science Certification Courses along with their price, mode of education course curriculum, and other basic stuff.

May 9, 2023

by Sarang S Babu

· 2,721 Views · 1 Like

Ways To Stop and Resume Your Kafka Producer/Consumer at Run-Time

In this blog, the reader will learn how to stop and resume a Kafka client or producer at runtime using two distinct methods.

May 9, 2023

by Ashok Gudise

· 6,337 Views · 1 Like

The Latest Data Engineering Topics