Data Engineering Resources

Database Integration Tests With Spring Boot and Testcontainers

In this tutorial, we'll show you how to use Testcontainers for integration testing with Spring Data JPA and a PostgreSQL database.

May 31, 2023

by Andrei Rogalenko

· 8,923 Views · 4 Likes

Constructing Real-Time Analytics: Fundamental Components and Architectural Framework — Part 1

Real-time analytics provide immediate insights on large data sets so data architects can make swift decisions and stay on the cutting edge of their industry.

May 31, 2023

by David Wang

· 2,362 Views · 1 Like

Data Exploration Using Serverless SQL Pool In Azure Synapse

In this detailed article, you will learn how to carry out data ingestion and analysis using Azure Synapse Serverless SQL Pool along with sample datasets.

May 31, 2023

by Mohan Krishna Mangamuri

· 2,791 Views · 1 Like

ChatGPT Will Not Replace Your Job, but the People Using ChatGPT as Their Assistant Will

Although generative AI is revolutionizing content creation, human creativity will remain essential for audience connection.

May 31, 2023

by Dr. Debashish Roy

· 2,806 Views · 1 Like

Deep Q-Learning Networks: Bridging the Gap from Virtual Games to Real-World Applications

A significant advancement in RL is the advent of Deep Q-Learning Networks (DQNs), which combine the power of deep learning with the strategic decision-making capabilities of Q-learning.

May 30, 2023

by Yifei Wang

CORE

· 4,252 Views · 5 Likes

Introduction To Git

Git is a powerful version control system for tracking and managing changes to code and files collaboratively and efficiently.

May 30, 2023

by Pradeep Gopalgowda

· 3,885 Views · 2 Likes

RAML vs. OAS: Which Is the Best API Specification for Your Project?

API spec languages make it easy for humans and machines to understand API designs. RAML and OAS are two options worth considering.

May 30, 2023

by Madhu Mallisetty

· 8,919 Views · 1 Like

Transactional Outbox Patterns Step by Step With Spring and Kotlin

Distributed microservices Transactional Outbox pattern step-by-step implementation guide with Reactive Spring and Kotlin with coroutines.

May 30, 2023

by Alexander Bryksin

· 6,404 Views · 5 Likes

Streamlining PHP Document Generation With AI: Optimizing the Process

Discover how AI enhances PHP document generation, streamlining and optimizing the process. Unleash the power of AI for efficient document generation.

May 30, 2023

by Padhma Sree

· 3,274 Views · 2 Likes

Enhancing Collaboration and Efficiency in DataOps With Git

In this article, we will explore how Git can improve the efficiency of DataOps and delve into the significance of DataOps for large-scale models.

May 30, 2023

by Zongwen Li

· 3,844 Views · 2 Likes

Send Email Using Spring Boot (SMTP Integration)

This article explores Spring Boot integration with SMTP and how to send emails from your very own Spring Boot application.

May 30, 2023

by Akash Verma

· 7,817 Views · 1 Like

Integrating AWS With Salesforce Using Terraform

This article covers the benefits of integration, steps for setting up AWS resources and configuring Salesforce, and provides Terraform code examples.

May 30, 2023

by Vladislav Bilay

· 10,645 Views · 3 Likes

Machine Learning Driving Innovation in the Digital Age

As machine learning (ML) is revolutionizing an enterprise's digital transformation, the path to successful ML implementation comes with its own set of challenges.

May 30, 2023

by Frederic Jacquet

CORE

· 3,304 Views · 1 Like

Seven Steps To Deploy Kedro Pipelines on Amazon EMR

In this post, the author explains how to launch an Amazon EMR cluster and how to deploy a Kedro project to run a Spark job.

May 30, 2023

by Jo Stichbury

CORE

· 3,588 Views · 2 Likes

Competing Consumers With Spring Boot and Hazelcast

Follow a simplified demo implementation of the competing Consumers pattern using Java, Spring Boot, and Hazelcast's distributed queue.

May 29, 2023

by Kyriakos Mandalas

CORE

· 8,115 Views · 11 Likes

Revolutionizing Algorithmic Trading: The Power of Reinforcement Learning

Delve into how reinforcement learning can enhance algorithmic trading, the challenges involved, and the future of this intersection of AI and finance.

May 29, 2023

by Yifei Wang

CORE

· 4,710 Views · 4 Likes

Getting Started With the YugabyteDB Managed REST API

In this article, learn how to generate an API key, list existing clusters, create a new cluster, and stream market orders into the cluster.

May 29, 2023

by Denis Magda

CORE

· 10,635 Views · 1 Like

How To Use Pandas and Matplotlib To Perform EDA In Python

In this article, we will explore how to use two popular Python libraries, Pandas and Matplotlib, to perform EDA.

May 29, 2023

by Stylianos Kampakis

· 6,293 Views · 5 Likes

Comparing Cloud Hosting vs. Self Hosting

In this article, we will zoom in on two popular software programs: Cloud Hosting and Self Hosting.

May 29, 2023

by Daniel Onugha

· 5,262 Views · 2 Likes

Data Freshness: Definition, Alerts To Use, and Other Best Practices

Data freshness is how frequently data is updated and refreshed. Understand common failure points and grab SQL alerts you can integrate into your data pipelines.

May 29, 2023

by Lior Gavish

· 3,112 Views · 1 Like

The Latest Data Engineering Topics