Data Engineering Resources

Introduction To Git

Git is a powerful version control system for tracking and managing changes to code and files collaboratively and efficiently.

May 30, 2023

by Pradeep Gopalgowda

· 4,853 Views · 3 Likes

RAML vs. OAS: Which Is the Best API Specification for Your Project?

API spec languages make it easy for humans and machines to understand API designs. RAML and OAS are two options worth considering.

May 30, 2023

by Madhu Mallisetty

· 14,033 Views · 1 Like

Transactional Outbox Patterns Step by Step With Spring and Kotlin

Distributed microservices Transactional Outbox pattern step-by-step implementation guide with Reactive Spring and Kotlin with coroutines.

May 30, 2023

by Alexander Bryksin

· 7,404 Views · 5 Likes

Streamlining PHP Document Generation With AI: Optimizing the Process

Discover how AI enhances PHP document generation, streamlining and optimizing the process. Unleash the power of AI for efficient document generation.

May 30, 2023

by Padhma Sree

· 3,968 Views · 2 Likes

Enhancing Collaboration and Efficiency in DataOps With Git

In this article, we will explore how Git can improve the efficiency of DataOps and delve into the significance of DataOps for large-scale models.

May 30, 2023

by Zongwen Li

· 4,597 Views · 2 Likes

Send Email Using Spring Boot (SMTP Integration)

This article explores Spring Boot integration with SMTP and how to send emails from your very own Spring Boot application.

May 30, 2023

by Akash Verma

· 9,339 Views · 1 Like

Integrating AWS With Salesforce Using Terraform

This article covers the benefits of integration, steps for setting up AWS resources and configuring Salesforce, and provides Terraform code examples.

May 30, 2023

by Vladislav Bilay

· 11,897 Views · 3 Likes

Machine Learning Driving Innovation in the Digital Age

As machine learning (ML) is revolutionizing an enterprise's digital transformation, the path to successful ML implementation comes with its own set of challenges.

May 30, 2023

by Frederic Jacquet

CORE

· 3,986 Views · 3 Likes

Seven Steps To Deploy Kedro Pipelines on Amazon EMR

In this post, the author explains how to launch an Amazon EMR cluster and how to deploy a Kedro project to run a Spark job.

May 30, 2023

by Jo Stichbury

CORE

· 4,121 Views · 2 Likes

Competing Consumers With Spring Boot and Hazelcast

Follow a simplified demo implementation of the competing Consumers pattern using Java, Spring Boot, and Hazelcast's distributed queue.

May 29, 2023

by Kyriakos Mandalas

CORE

· 9,793 Views · 12 Likes

Revolutionizing Algorithmic Trading: The Power of Reinforcement Learning

Delve into how reinforcement learning can enhance algorithmic trading, the challenges involved, and the future of this intersection of AI and finance.

May 29, 2023

by Yifei Wang

CORE

· 7,710 Views · 4 Likes

Getting Started With the YugabyteDB Managed REST API

In this article, learn how to generate an API key, list existing clusters, create a new cluster, and stream market orders into the cluster.

May 29, 2023

by Denis Magda

CORE

· 11,589 Views · 1 Like

How To Use Pandas and Matplotlib To Perform EDA In Python

In this article, we will explore how to use two popular Python libraries, Pandas and Matplotlib, to perform EDA.

May 29, 2023

by Stylianos Kampakis

· 7,550 Views · 5 Likes

Comparing Cloud Hosting vs. Self Hosting

In this article, we will zoom in on two popular software programs: Cloud Hosting and Self Hosting.

May 29, 2023

by Daniel Onugha

· 7,805 Views · 2 Likes

Data Freshness: Definition, Alerts To Use, and Other Best Practices

Data freshness is how frequently data is updated and refreshed. Understand common failure points and grab SQL alerts you can integrate into your data pipelines.

May 29, 2023

by Lior Gavish

· 3,665 Views · 1 Like

Test Data Tutorial: A Comprehensive Guide With Examples and Best Practices

This detailed tutorial will teach what Test Data is, why it is crucial for testers, its advantages and disadvantages, and more.

May 29, 2023

by Sarah Elson

· 2,973 Views · 1 Like

What to Pay Attention to as Automation Upends the Developer Experience

The developer experience is changing faster than ever. Here's a primer on where things stand right now and what developers can expect.

May 26, 2023

by Shomron Jacob

· 6,130 Views · 2 Likes

What ChatGPT Needs Is Context

Like the calculator, the spreadsheet, and the internet, AI-driven LLM tools are likely to change HOW we do our work, but not the fact that humans will still be the ones doing the work in the first place.

May 26, 2023

by Leon Adato

· 6,198 Views · 3 Likes

Optimal Use of Snowflake Warehouse and Tables

The third article of this series presents a deep-dive into how efficiently we can use Snowflake tables and warehouses and how data sharing occurs across accounts.

May 26, 2023

by Kedhar Natekar

· 4,332 Views · 1 Like

5 Key Concepts for MQTT Broker in Sparkplug Specification

In the Sparkplug specification, an MQTT broker is an indispensable component to incorporate the five conceptual capabilities.

May 26, 2023

by Tao Dekun

· 5,111 Views · 2 Likes

The Latest Data Engineering Topics