Data Engineering Resources

Java UDFs and Stored Procedures for Data Engineers: A Hands-On Guide

See how to build Java-based stored procedures and UDFs in Snowflake using Snowpark APIs for scalable, efficient data workflows, including async processing and file handling.

April 10, 2025

by Fawaz Ghali, PhD

CORE

· 7,351 Views · 3 Likes

Python Packages for Validating Database Migration Projects

This article analyzes three widely used Python libraries — Pandas, SQLAlchemy, and PyMySQL/psycopg2 — detailing their capabilities, advantages, and limitations.

April 10, 2025

by Vignesh Govindarajan Ravichandran

· 4,356 Views

Why State Management Is the #1 Challenge for Agentic AI

Explore the unique state management challenges posed by agentic AI, and see why traditional cloud-native approaches fall short as AI agents evolve to learn and adapt over time.

April 9, 2025

by Jason Bloomberg

· 3,182 Views · 2 Likes

Unlocking the Power of Serverless AI/ML on AWS: Expert Strategies for Scalable and Secure Applications

Learn how to combine AWS Serverless with AI/ML to build scalable, automated, and intelligent workflows with this practical guide.

April 9, 2025

by Bal Reddy Cherlapally

· 6,766 Views · 1 Like

How AI Automation Increases Research Productivity

Discover how AI automation revolutionizes research productivity through streamlined data collection, workflow optimization, and real-world applications in various industries.

April 9, 2025

by Kevin Vu

· 3,680 Views · 1 Like

Context Search With AWS Bedrock, Cohere Model, and Spring AI

In this article, learn how to build a simple Java application using Spring AI and Amazon Bedrock to generate and compare text embeddings with Cohere’s Embed Multilingual v3 model.

April 9, 2025

by Danil Temnikov

CORE

· 73,944 Views · 22 Likes

It's 2025: How Do You Choose Between Doris and ClickHouse?

Doris or ClickHouse? Doris excels in complex SQL analytics, real-time updates, and usability, while ClickHouse offers extreme performance in single-table queries.

April 9, 2025

by Zen Hua

· 6,005 Views · 2 Likes

Achieving High Genericity in Code

Designing a generic, dynamic tool for efficiently copying complex transactional data across Oracle DB environments with minimal maintenance.

April 9, 2025

by Vaseem Anjum

· 3,066 Views · 1 Like

Spring Boot Sample Application Part 1: Introduction and Configuration

This tutorial covers building a bilingual Spring Boot application for a digital library, detailing setup, database integration, and advanced features like caching and error management.

April 9, 2025

by Liliz EQ

· 5,055 Views · 5 Likes

Building Scalable and Efficient Architectures With ECS Serverless and Event-Driven Design

Learn how to build scalable and efficient architectures using ECS serverless and event-driven design by adopting serverless architecture.

April 9, 2025

by Bal Reddy Cherlapally

· 6,109 Views · 1 Like

Why Clean Data Is the Foundation of Successful AI Systems

Poor data quality costs enterprises $406M annually. Learn in this article some key challenges and best practices for ensuring data quality in AI systems.

April 8, 2025

by Vaishali Mishra

· 4,591 Views · 2 Likes

AWS S3 Strategies for Scalable and Secure Data Lake Storage

Optimize your Amazon S3 data lake with strategic bucket configurations, data layers, encryption, and lifecycle policies for security, efficiency, and cost savings.

April 8, 2025

by Digvijay Waghela

· 8,431 Views

Evaluating Performance Gains in MySQL Lock Scheduling Algorithms

This article shows that MySQL’s CATS algorithm offers only a small performance gain over FIFO once deadlock logging interference is removed.

April 8, 2025

by Bin Wang

· 5,361 Views · 1 Like

Understanding Structured Concurrency in Java

Java's structured concurrency simplifies concurrent programming by automating cancellation, preventing thread leaks, and improving task management.

April 8, 2025

by Ammar Husain

CORE

· 8,138 Views · 4 Likes

Optimizing Data Storage With Hybrid Partitioned Tables in Oracle 19c

Learn how to implement Hybrid Partitioned Tables (HPT) to streamline data management, boost query performance, and cut storage costs.

April 8, 2025

by arvind toorpu

CORE

· 4,261 Views · 3 Likes

Why Rate Limiting Matters in Istio and How to Implement It

In this post, we’ll explore why rate limiting is important in Istio and show you how to set it up effectively.

April 8, 2025

by Josephine Eskaline Joyce

CORE

· 8,094 Views · 10 Likes

AI-Powered Defenses Against Clickjacking in Finance

Clickjacking is not a new online threat, but it continues to evolve and stay relevant. This article discusses AI-driven techniques for combating this attack.

April 8, 2025

by Dipankar Saha

· 3,042 Views

Optimize Slow Data Queries With Doris JOIN Strategies

Today, let's dive into the world of JOIN operations in Doris and see how you can transform your queries into "lightning-fast" operations that will impress your boss!

April 7, 2025

by Zen Hua

· 3,238 Views · 2 Likes

How I Taught OpenAI a New Programming Language With Fine-Tuning

We fine-tuned OpenAI to understand a programming language it had no prior knowledge of. This article explains what we learned.

April 7, 2025

by Thomas Hansen

CORE

· 5,149 Views · 1 Like

Three AI Superpowers: Classification AI vs Predictive AI vs Generative AI

Learn the difference between classification, predictive, and generative AI — what they do and how they’re used to sort data, forecast trends, and create content.

April 7, 2025

by Mahesh Ganesamoorthi

· 4,069 Views

The Latest Data Engineering Topics