Data Engineering Resources

Materialized Views in Data Stream Processing With RisingWave

Materialized views enhance data streaming by improving incremental computation, enabling efficient retrieval and calculation of aggregated or pre-processed data.

March 3, 2025

by Gautam Goswami

CORE

· 3,817 Views · 3 Likes

Understanding the Data Culture

A data culture fosters data and AI use to improve decision-making, drive innovation, build trust, and ensure organizational success through collaboration.

March 3, 2025

by Abrar Ahmed Syed

· 3,603 Views · 5 Likes

Modern Data Processing Libraries: Beyond Pandas

In this article, we explore the alternatives to pandas for data processing and data analysis. We'll compare and contrast based on performance.

March 3, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 6,892 Views · 7 Likes

AI in Agile Product Teams

In this article, learn about AI in agile product teams, gain insights from deep research, and explore what it means for your practice as an agile practitioner.

March 3, 2025

by Stefan Wolpers

CORE

· 4,817 Views · 4 Likes

Doris Lakehouse Integration: A New Approach to Data Analysis

Doris Lakehouse Integration bridges data lakes and warehouses and enables seamless access, faster queries, unified management, and greater data value.

February 28, 2025

by Darren Xu

· 6,504 Views · 4 Likes

Exploring IoT's Top WebRTC Use Cases

WebRTC can handle both high-quality media streaming and efficient data sharing, making it a versatile tool for device developers.

February 28, 2025

by Carsten Rhod Gregersen

· 3,956 Views · 2 Likes

Exploring Embeddings API With Java and Spring AI

Exploring how to build a Spring AI application that uses OpenAI's embeddings API to find the most relevant products based on user input.

February 28, 2025

by Danil Temnikov

CORE

· 12,517 Views · 10 Likes

XAI for Fraud Detection Models

We will explore the importance of eXplanation in fraud detection models and learn how it can help to understand different patterns of fraud in our system.

February 28, 2025

by Kalpan Dharamshi

· 5,888 Views · 2 Likes

Loss Functions: The Key to Improving AI Predictions

Loss functions measure how wrong an AI's predictions are. Different loss functions are used for different types of problems (regression or classification).

February 28, 2025

by Venkata Sai Manoj Pasupuleti

· 2,884 Views · 1 Like

Modern ETL Architecture: dbt on Snowflake With Airflow

Build a scalable ETL pipeline with dbt, Snowflake, and Airflow, and address data engineering challenges with modular architecture, CI/CD, and best practices.

February 27, 2025

by Digvijay Waghela

· 6,682 Views · 3 Likes

Top Methods to Improve ETL Performance Using SSIS

Improve ETL performance in SSIS with parallel extraction, optimized transformations, and proper configuration of concurrency, batch sizes, and data types.

February 27, 2025

by DZone Editorial

· 6,024 Views · 3 Likes

Micronaut vs Spring Boot: A Detailed Comparison

Micronaut is efficient, lightweight, and fast, making it a strong alternative, but Spring Boot remains dominant due to its robust, mature ecosystem and community support.

February 27, 2025

by Sulakshana Singh

· 16,496 Views · 5 Likes

Handling Embedded Data in NoSQL With Java

Handle embedded data in NoSQL with Java using Jakarta NoSQL. Compare flat vs. grouped structures using @Embeddable to optimize document storage and querying in MongoDB.

February 27, 2025

by Otavio Santana

CORE

· 7,084 Views · 5 Likes

The Outbox Pattern: Reliable Messaging in Distributed Systems

The Outbox Pattern is a design pattern used in distributed systems to ensure reliable messaging across different services.

February 27, 2025

by Narendra Lakshmana gowda

· 7,264 Views · 5 Likes

Efficient Multimodal Data Processing: A Technical Deep Dive

Efficient multimodal data processing using GPU-accelerated pipelines, neural networks, and hybrid storage for scalable, low-latency AI-driven applications.

February 27, 2025

by Praneeth Reddy Vatti

· 6,345 Views · 4 Likes

Cloud-Driven Analytics Solution Strategy in Healthcare

Detailed insights into compute resource management, cluster optimization, storage efficiency, and cost governance in cloud-based environments.

February 27, 2025

by Abrar Ahmed Syed

· 5,049 Views · 6 Likes

Networking in DevOps: Your Beginner Guide

In this article, we'll cover some of the basics of DevOps networking: why it is so crucial and how you can use it to smooth out your processes.

February 27, 2025

by Rocky Sah

· 6,286 Views · 4 Likes

Banking Fraud Prevention With DeepSeek AI and AI Explainability

AI-driven fraud detection boosts accuracy and transparency using XGBoost, SHAP, and real-time dashboards, providing scalable solutions to fight fraud.

February 26, 2025

by Swapnil Patil

· 43,833 Views · 3 Likes

Identity and Access Management Solution to Safeguard LLMs

One of the essential security measures to address LLM security involves securing access to the LLMs so that only authorized individuals can access data.

February 26, 2025

by Anant Wairagade

· 5,243 Views · 6 Likes

How to Scale Elasticsearch to Solve Your Scalability Issues

Scaling Elasticsearch requires balancing sharding, query performance, and memory tuning for optimal efficiency in high-traffic, real-time applications.

February 26, 2025

by Vivek Kumar

· 8,482 Views · 4 Likes

The Latest Data Engineering Topics