Data Engineering Resources

How I Made My Liberty Microservices Load-Resilient

The journey of a cloud incident that transformed fragile Liberty microservices into a resilient, self-healing system that scales effortlessly under load.

March 3, 2025

by Josephine Eskaline Joyce

CORE

· 4,474 Views · 6 Likes

API Management as Code: A Declarative Approach to Scaling API Operations

API management as code is a declarative approach to managing APIs at scale, providing benefits like automation, consistency, collaboration, and scalability.

March 3, 2025

by Hugo Guerrero

CORE

· 4,825 Views · 1 Like

Materialized Views in Data Stream Processing With RisingWave

Materialized views enhance data streaming by improving incremental computation, enabling efficient retrieval and calculation of aggregated or pre-processed data.

March 3, 2025

by Gautam Goswami

CORE

· 3,709 Views · 2 Likes

Understanding the Data Culture

A data culture fosters data and AI use to improve decision-making, drive innovation, build trust, and ensure organizational success through collaboration.

March 3, 2025

by Abrar Ahmed Syed

· 3,515 Views · 5 Likes

Modern Data Processing Libraries: Beyond Pandas

In this article, we explore the alternatives to pandas for data processing and data analysis. We'll compare and contrast based on performance.

March 3, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 6,690 Views · 6 Likes

AI in Agile Product Teams

In this article, learn about AI in agile product teams, gain insights from deep research, and explore what it means for your practice as an agile practitioner.

March 3, 2025

by Stefan Wolpers

CORE

· 4,710 Views · 4 Likes

Doris Lakehouse Integration: A New Approach to Data Analysis

Doris Lakehouse Integration bridges data lakes and warehouses and enables seamless access, faster queries, unified management, and greater data value.

February 28, 2025

by Darren Xu

· 6,360 Views · 3 Likes

Exploring IoT's Top WebRTC Use Cases

WebRTC can handle both high-quality media streaming and efficient data sharing, making it a versatile tool for device developers.

February 28, 2025

by Carsten Rhod Gregersen

· 3,867 Views · 1 Like

Exploring Embeddings API With Java and Spring AI

Exploring how to build a Spring AI application that uses OpenAI's embeddings API to find the most relevant products based on user input.

February 28, 2025

by Danil Temnikov

CORE

· 12,212 Views · 10 Likes

XAI for Fraud Detection Models

We will explore the importance of eXplanation in fraud detection models and learn how it can help to understand different patterns of fraud in our system.

February 28, 2025

by Kalpan Dharamshi

· 5,768 Views · 2 Likes

Loss Functions: The Key to Improving AI Predictions

Loss functions measure how wrong an AI's predictions are. Different loss functions are used for different types of problems (regression or classification).

February 28, 2025

by Venkata Sai Manoj Pasupuleti

· 2,784 Views · 1 Like

Modern ETL Architecture: dbt on Snowflake With Airflow

Build a scalable ETL pipeline with dbt, Snowflake, and Airflow, and address data engineering challenges with modular architecture, CI/CD, and best practices.

February 27, 2025

by Digvijay Waghela

· 6,426 Views · 2 Likes

Top Methods to Improve ETL Performance Using SSIS

Improve ETL performance in SSIS with parallel extraction, optimized transformations, and proper configuration of concurrency, batch sizes, and data types.

February 27, 2025

by DZone Editorial

· 5,825 Views · 1 Like

Micronaut vs Spring Boot: A Detailed Comparison

Micronaut is efficient, lightweight, and fast, making it a strong alternative, but Spring Boot remains dominant due to its robust, mature ecosystem and community support.

February 27, 2025

by Sulakshana Singh

· 16,203 Views · 5 Likes

Handling Embedded Data in NoSQL With Java

Handle embedded data in NoSQL with Java using Jakarta NoSQL. Compare flat vs. grouped structures using @Embeddable to optimize document storage and querying in MongoDB.

February 27, 2025

by Otavio Santana

CORE

· 6,936 Views · 5 Likes

The Outbox Pattern: Reliable Messaging in Distributed Systems

The Outbox Pattern is a design pattern used in distributed systems to ensure reliable messaging across different services.

February 27, 2025

by Narendra Lakshmana gowda

· 6,902 Views · 5 Likes

Efficient Multimodal Data Processing: A Technical Deep Dive

Efficient multimodal data processing using GPU-accelerated pipelines, neural networks, and hybrid storage for scalable, low-latency AI-driven applications.

February 27, 2025

by Praneeth Reddy Vatti

· 6,152 Views · 4 Likes

Cloud-Driven Analytics Solution Strategy in Healthcare

Detailed insights into compute resource management, cluster optimization, storage efficiency, and cost governance in cloud-based environments.

February 27, 2025

by Abrar Ahmed Syed

· 4,934 Views · 5 Likes

Networking in DevOps: Your Beginner Guide

In this article, we'll cover some of the basics of DevOps networking: why it is so crucial and how you can use it to smooth out your processes.

February 27, 2025

by Rocky Sah

· 6,119 Views · 4 Likes

Banking Fraud Prevention With DeepSeek AI and AI Explainability

AI-driven fraud detection boosts accuracy and transparency using XGBoost, SHAP, and real-time dashboards, providing scalable solutions to fight fraud.

February 26, 2025

by Swapnil Patil

· 43,650 Views · 3 Likes

The Latest Data Engineering Topics