Data Engineering Resources

Implementing Real-Time Credit Card Fraud Detection With Apache Flink on AWS

Real-time fraud detection systems are essential for identifying and preventing fraudulent transactions as they occur. Apache Flink is useful in this scenario.

July 1, 2024

by Harsh Daiya

CORE

· 8,119 Views · 4 Likes

PostgreSQL BiDirectional Replication

Previously we ran Debezium in Embedded mode. In this blog, we shall focus on replication and, more specifically, bidirectional replication.

June 28, 2024

by Emmanouil Gkatziouras

CORE

· 11,788 Views · 3 Likes

Leveraging Microsoft Graph API for Unified Data Access and Insights

This article explores the capabilities of Microsoft Graph API and how it can be utilized to unify data access and gain insights.

June 28, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 12,482 Views · 2 Likes

AWS CDK: Infrastructure as Abstract Data Types

Begin a series examining CDK as a high-level object-oriented abstraction, defining cloud infrastructure by leveraging the power of programming languages.

June 28, 2024

by Nicolas Duminil

CORE

· 8,513 Views · 4 Likes

Pure Storage Accelerates Application Modernization With Robust Kubernetes and Cloud-Native Solutions

Empowering developers and IT teams to modernize applications with seamless Kubernetes integration, advanced data services, and flexible consumption models.

June 28, 2024

by Tom Smith

CORE

· 12,729 Views · 2 Likes

Partitioning Hot and Cold Data Tier in Apache Kafka Cluster for Optimal Performance

Discover how by partitioning the hot and cold data tiers in the Apache Kafka Cluster, we can optimize storage resources based on data characteristics.

June 28, 2024

by Gautam Goswami

CORE

· 10,136 Views · 6 Likes

Spring AI: How To Write GenAI Applications With Java

In this article, take a look at how to write GenAI applications with Java using the Spring AI framework and utilize RAG for improving answers.

June 28, 2024

by Jennifer Reif

CORE

· 10,700 Views · 7 Likes

Node.js Walkthrough: Build a Simple Event-Driven Application With Kafka

Build a real-time event-driven app with Node.js and Kafka on Heroku. Follow this step-by-step guide to set up, deploy, and manage your application efficiently.

June 27, 2024

by Alvin Lee

CORE

· 16,553 Views · 3 Likes

On-Demand-Schedulers With MuleSoft CloudHub APIs

In this article, learn how to use MuleSoft's CloudHub APIs to run schedulers of an application on demand as well as how to access payload in HTML.

June 27, 2024

by Anupam Nath

· 4,901 Views · 1 Like

Data Governance: Data Integration (Part 4)

It's important to have a strong data governance framework in place when integrating data from different source systems. Learn more!

June 27, 2024

by Sukanya Konatam

· 14,213 Views · 2 Likes

LLM Orchestrator: The Symphony of AI Services

Explore how software evolved from monolithic structures to AI's LLM Orchestrator, boosting enterprise efficiency and decision-making.

June 27, 2024

by Navveen Balani

· 4,319 Views · 2 Likes

Hammerspace Empowers GPU Computing With Enhanced S3 Data Orchestration

Hammerspace adds S3 support to its Global Data Platform, enabling automated orchestration of object data to GPU resources alongside file data.

June 27, 2024

by Tom Smith

CORE

· 7,502 Views · 1 Like

Mastering System Design: A Comprehensive Guide to System Scaling for Millions, Part 2

Distributed caching improves performance and scalability. This article explores strategies like sharding, horizontal scaling, and various caching policies.

June 27, 2024

by Alireza Rahmani Khalili

CORE

· 8,604 Views · 5 Likes

The Role of AI in Low- and No-Code Development

AI's integration into low- and no-code development accelerates app creation by leveraging capabilities like automated code generation and intelligent assistants.

June 27, 2024

by Eric Goebelbecker

CORE

· 6,632 Views · 2 Likes

Building Kafka Producer With Spring Boot

In this article, I am going to show you how to build Message Publisher using Apache Kafka and Spring Boot. First, we will talk about what Apache Kafka is.

June 26, 2024

by Sai Krishna Reddy Chityala

· 10,717 Views · 3 Likes

Cluster Logging of Telecom 5G IOT Microservice Pods

Learn how Kibana visualizes data indexed in Elasticsearch log storage for vast 5G Telecom data volumes in the Kubernetes Cloud.

June 26, 2024

by BINU SUDHAKARAN PILLAI

· 16,004 Views · 5 Likes

Pure Storage Unveils Groundbreaking Innovations in AI, Automation, and Cyber Resilience at Accelerate 2024

Pure Storage announces next-gen storage automation, AI-powered management, and advanced cyber resilience solutions at Accelerate 2024 to make storage simpler.

June 26, 2024

by Tom Smith

CORE

· 10,010 Views · 1 Like

Documenting a Spring REST API Using Smart-doc

Documentation is essential. In this article, we will explore how to use Smart-doc to generate documentation for a Spring Boot REST API.

June 26, 2024

by sun yu

· 13,165 Views · 3 Likes

Unleashing the Power of Redis for Vector Database Applications

Redis, an in-memory data store, efficiently handles high-dimensional vector data for machine learning, providing fast, scalable, and rich querying capabilities.

June 26, 2024

by Lalithkumar Prakashchand

· 21,234 Views · 2 Likes

What Is ELT?

Learn about ELT (Extract, Load, Transform), a modern data management approach that loads raw data into cloud systems for scalable, real-time transformation and analytics.

June 25, 2024

by Suhas Jangoan

· 9,344 Views · 3 Likes

The Latest Data Engineering Topics