Data Engineering Resources

Building a Weather Service With Genkit and AI

AI-powered weather service using Genkit, TypeScript, OpenWeatherAPI, and GitHub Models. Uses OpenAI o3-mini for AI responses.

March 4, 2025

by Xavier Portilla Edo

CORE

· 5,473 Views · 1 Like

AI Agents for Data Warehousing

AI agents are revolutionizing data warehousing by enhancing efficiency, accuracy, and automation across various aspects of data management today.

March 4, 2025

by Ajay Tanikonda

· 4,588 Views · 1 Like

The Critical Role of CISOs in Managing IAM, Including NHIs

NHIs outnumber human users in enterprises, yet many IAM strategies ignore them. Learn why CISOs must own NHI governance to prevent security breaches.

March 4, 2025

by Dwayne McDaniel

· 2,602 Views · 2 Likes

Next.js Theming: CSS Variables for Adaptive Data Visualization

CSS variables revolutionize the theming of apps by allowing theme changes in real time. This makes them suitable for modern apps having features like data visualization.

March 4, 2025

by Anujkumarsinh Donvir

CORE

· 5,383 Views · 5 Likes

Handling Dynamic Data Using Schema Evolution in Delta

This article is intended to help data practitioners learn an effective way of dealing with dynamically changing data through Delta Lake.

March 3, 2025

by Hanza Parayil Salim

· 3,077 Views

Time Data Series: The Rest of the Story

Things I've learned about how the PHP Zmanim library helps calculate specific and special times that relate to Jewish life.

March 3, 2025

by Leon Adato

· 3,632 Views · 2 Likes

How I Made My Liberty Microservices Load-Resilient

The journey of a cloud incident that transformed fragile Liberty microservices into a resilient, self-healing system that scales effortlessly under load.

March 3, 2025

by Josephine Eskaline Joyce

CORE

· 4,421 Views · 6 Likes

API Management as Code: A Declarative Approach to Scaling API Operations

API management as code is a declarative approach to managing APIs at scale, providing benefits like automation, consistency, collaboration, and scalability.

March 3, 2025

by Hugo Guerrero

CORE

· 4,767 Views · 1 Like

Materialized Views in Data Stream Processing With RisingWave

Materialized views enhance data streaming by improving incremental computation, enabling efficient retrieval and calculation of aggregated or pre-processed data.

March 3, 2025

by Gautam Goswami

CORE

· 3,653 Views · 2 Likes

Understanding the Data Culture

A data culture fosters data and AI use to improve decision-making, drive innovation, build trust, and ensure organizational success through collaboration.

March 3, 2025

by Abrar Ahmed Syed

· 3,493 Views · 5 Likes

Modern Data Processing Libraries: Beyond Pandas

In this article, we explore the alternatives to pandas for data processing and data analysis. We'll compare and contrast based on performance.

March 3, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 6,581 Views · 6 Likes

AI in Agile Product Teams

In this article, learn about AI in agile product teams, gain insights from deep research, and explore what it means for your practice as an agile practitioner.

March 3, 2025

by Stefan Wolpers

CORE

· 4,662 Views · 4 Likes

Doris Lakehouse Integration: A New Approach to Data Analysis

Doris Lakehouse Integration bridges data lakes and warehouses and enables seamless access, faster queries, unified management, and greater data value.

February 28, 2025

by Darren Xu

· 6,307 Views · 3 Likes

Exploring IoT's Top WebRTC Use Cases

WebRTC can handle both high-quality media streaming and efficient data sharing, making it a versatile tool for device developers.

February 28, 2025

by Carsten Rhod Gregersen

· 3,843 Views · 1 Like

Exploring Embeddings API With Java and Spring AI

Exploring how to build a Spring AI application that uses OpenAI's embeddings API to find the most relevant products based on user input.

February 28, 2025

by Danil Temnikov

CORE

· 12,051 Views · 10 Likes

XAI for Fraud Detection Models

We will explore the importance of eXplanation in fraud detection models and learn how it can help to understand different patterns of fraud in our system.

February 28, 2025

by Kalpan Dharamshi

· 5,722 Views · 2 Likes

Loss Functions: The Key to Improving AI Predictions

Loss functions measure how wrong an AI's predictions are. Different loss functions are used for different types of problems (regression or classification).

February 28, 2025

by Venkata Sai Manoj Pasupuleti

· 2,745 Views · 1 Like

Modern ETL Architecture: dbt on Snowflake With Airflow

Build a scalable ETL pipeline with dbt, Snowflake, and Airflow, and address data engineering challenges with modular architecture, CI/CD, and best practices.

February 27, 2025

by Digvijay Waghela

· 6,325 Views · 2 Likes

Top Methods to Improve ETL Performance Using SSIS

Improve ETL performance in SSIS with parallel extraction, optimized transformations, and proper configuration of concurrency, batch sizes, and data types.

February 27, 2025

by DZone Editorial

· 5,719 Views · 1 Like

Micronaut vs Spring Boot: A Detailed Comparison

Micronaut is efficient, lightweight, and fast, making it a strong alternative, but Spring Boot remains dominant due to its robust, mature ecosystem and community support.

February 27, 2025

by Sulakshana Singh

· 16,085 Views · 5 Likes

The Latest Data Engineering Topics