Data Engineering Resources

Enhancing Collaboration and Efficiency in DataOps With Git

In this article, we will explore how Git can improve the efficiency of DataOps and delve into the significance of DataOps for large-scale models.

May 30, 2023

by Zongwen Li

· 4,475 Views · 2 Likes

Send Email Using Spring Boot (SMTP Integration)

This article explores Spring Boot integration with SMTP and how to send emails from your very own Spring Boot application.

May 30, 2023

by Akash Verma

· 9,188 Views · 1 Like

Integrating AWS With Salesforce Using Terraform

This article covers the benefits of integration, steps for setting up AWS resources and configuring Salesforce, and provides Terraform code examples.

May 30, 2023

by Vladislav Bilay

· 11,809 Views · 3 Likes

Machine Learning Driving Innovation in the Digital Age

As machine learning (ML) is revolutionizing an enterprise's digital transformation, the path to successful ML implementation comes with its own set of challenges.

May 30, 2023

by Frederic Jacquet

CORE

· 3,896 Views · 3 Likes

Seven Steps To Deploy Kedro Pipelines on Amazon EMR

In this post, the author explains how to launch an Amazon EMR cluster and how to deploy a Kedro project to run a Spark job.

May 30, 2023

by Jo Stichbury

CORE

· 4,009 Views · 2 Likes

Competing Consumers With Spring Boot and Hazelcast

Follow a simplified demo implementation of the competing Consumers pattern using Java, Spring Boot, and Hazelcast's distributed queue.

May 29, 2023

by Kyriakos Mandalas

CORE

· 9,615 Views · 12 Likes

Revolutionizing Algorithmic Trading: The Power of Reinforcement Learning

Delve into how reinforcement learning can enhance algorithmic trading, the challenges involved, and the future of this intersection of AI and finance.

May 29, 2023

by Yifei Wang

CORE

· 7,571 Views · 4 Likes

Getting Started With the YugabyteDB Managed REST API

In this article, learn how to generate an API key, list existing clusters, create a new cluster, and stream market orders into the cluster.

May 29, 2023

by Denis Magda

CORE

· 11,450 Views · 1 Like

How To Use Pandas and Matplotlib To Perform EDA In Python

In this article, we will explore how to use two popular Python libraries, Pandas and Matplotlib, to perform EDA.

May 29, 2023

by Stylianos Kampakis

· 7,362 Views · 5 Likes

Comparing Cloud Hosting vs. Self Hosting

In this article, we will zoom in on two popular software programs: Cloud Hosting and Self Hosting.

May 29, 2023

by Daniel Onugha

· 7,622 Views · 2 Likes

Data Freshness: Definition, Alerts To Use, and Other Best Practices

Data freshness is how frequently data is updated and refreshed. Understand common failure points and grab SQL alerts you can integrate into your data pipelines.

May 29, 2023

by Lior Gavish

· 3,565 Views · 1 Like

Test Data Tutorial: A Comprehensive Guide With Examples and Best Practices

This detailed tutorial will teach what Test Data is, why it is crucial for testers, its advantages and disadvantages, and more.

May 29, 2023

by Sarah Elson

· 2,930 Views · 1 Like

What to Pay Attention to as Automation Upends the Developer Experience

The developer experience is changing faster than ever. Here's a primer on where things stand right now and what developers can expect.

May 26, 2023

by Shomron Jacob

· 6,039 Views · 2 Likes

What ChatGPT Needs Is Context

Like the calculator, the spreadsheet, and the internet, AI-driven LLM tools are likely to change HOW we do our work, but not the fact that humans will still be the ones doing the work in the first place.

May 26, 2023

by Leon Adato

· 6,116 Views · 3 Likes

Optimal Use of Snowflake Warehouse and Tables

The third article of this series presents a deep-dive into how efficiently we can use Snowflake tables and warehouses and how data sharing occurs across accounts.

May 26, 2023

by Kedhar Natekar

· 4,269 Views · 1 Like

5 Key Concepts for MQTT Broker in Sparkplug Specification

In the Sparkplug specification, an MQTT broker is an indispensable component to incorporate the five conceptual capabilities.

May 26, 2023

by Tao Dekun

· 5,013 Views · 2 Likes

Solving Three Medium-Level Coding

In this article, we will explore three medium-level coding problems and provide solutions for each of them.

May 26, 2023

by Volha Kurcheuskaya

· 4,906 Views · 1 Like

Navigating the Divide: Distinctions Between Time Series Data and Relational Data

To anyone unfamiliar, time series looks similar to relational data, but it is very different in nature: understanding both is key.

May 26, 2023

by Rick Spencer

· 6,873 Views · 1 Like

How To Integrate Microsoft Team With Cypress Cloud

The Microsoft Teams integration with Cypress allows you to see your test results directly in your Microsoft Teams channels.

May 26, 2023

by Kailash Pathak

CORE

· 6,420 Views · 2 Likes

RBAC With API Gateway and Open Policy Agent (OPA)

In this article, you will learn how to enable role-based access control (RBAC) with open-source API Gateway Apache APISIX and Open Policy Agent (OPA).

May 25, 2023

by Bobur Umurzokov

· 7,335 Views · 5 Likes

The Latest Data Engineering Topics