Data Engineering Resources

Emerging Data Architectures: The Future of Data Management

This article explores the latest advancements in data architecture, focusing on frameworks and newer paradigms such as LakeDB and zero ETL architectures.

April 15, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 7,875 Views · 10 Likes

A Deep Dive into Apache Doris Indexes

Apache Doris offers various index types, each designed for specific needs. Let’s delve into their features and discover what drives their exceptional performance.

April 14, 2025

by Darren Xu

· 5,964 Views

How Doris + Hudi Turned the Impossible Into the Everyday

Want to know how this "data giant ship" navigates the waves? Follow this article to uncover the amazing story of Doris and Hudi, the "dream team" of data.

April 14, 2025

by Zen Hua

· 5,813 Views · 4 Likes

Introducing Neuron AI: Create Full-Featured AI Agents in PHP

A complete open-source toolkit for AI development in PHP. Create RAG systems to use the powerful capabilities of LLMs on your own private data.

April 14, 2025

by Valerio Barbera

· 4,568 Views · 2 Likes

Why Generative AI and Data Streaming Are Replacing Visual Coding With Low-Code/No-Code Platforms

Low-code or no-code tools simplify development but have limitations. Generative AI and data streaming (Kafka, Flink) reshape real-time, scalable workflows.

April 14, 2025

by Kai Wähner

CORE

· 2,700 Views

Critical Thinking In The Age Of AI-Generated Code

Learn how AI-generated code impacts maintainability, productivity, and quality. Explore code reviewing, testing strategies, and best practices for long-term success.

April 14, 2025

by Stelios Manioudakis

CORE

· 39,826 Views · 16 Likes

Introducing SmallRye LLM: Injecting Langchain4J AI Services

A quick guide on how Microprofile developers can leverage the power of CDI and Microprofile features on their Langchain4J AI Services in their enterprise applications.

April 14, 2025

by BUHAKE SINDI

CORE

· 6,957 Views · 6 Likes

Design Patterns for Scalable Test Automation Frameworks

Essential design principles that improve the scalability, maintainability, and efficiency of test automation frameworks.

April 11, 2025

by Sarvesh Peddi

· 5,189 Views · 1 Like

Transforming Data Analytics by Combining SQL and ML

Learn how AI and ML extend SQL's capabilities for advanced analytics, predictive insights, and query optimization, transforming database interactions.

April 10, 2025

by Ramalakshmi Murugan

· 5,479 Views · 2 Likes

Java UDFs and Stored Procedures for Data Engineers: A Hands-On Guide

See how to build Java-based stored procedures and UDFs in Snowflake using Snowpark APIs for scalable, efficient data workflows, including async processing and file handling.

April 10, 2025

by Fawaz Ghali, PhD

CORE

· 7,176 Views · 3 Likes

Python Packages for Validating Database Migration Projects

This article analyzes three widely used Python libraries — Pandas, SQLAlchemy, and PyMySQL/psycopg2 — detailing their capabilities, advantages, and limitations.

April 10, 2025

by Vignesh Govindarajan Ravichandran

· 4,175 Views

Why State Management Is the #1 Challenge for Agentic AI

Explore the unique state management challenges posed by agentic AI, and see why traditional cloud-native approaches fall short as AI agents evolve to learn and adapt over time.

April 9, 2025

by Jason Bloomberg

· 3,124 Views · 2 Likes

Unlocking the Power of Serverless AI/ML on AWS: Expert Strategies for Scalable and Secure Applications

Learn how to combine AWS Serverless with AI/ML to build scalable, automated, and intelligent workflows with this practical guide.

April 9, 2025

by Bal Reddy Cherlapally

· 6,608 Views · 1 Like

How AI Automation Increases Research Productivity

Discover how AI automation revolutionizes research productivity through streamlined data collection, workflow optimization, and real-world applications in various industries.

April 9, 2025

by Kevin Vu

· 3,536 Views · 1 Like

Context Search With AWS Bedrock, Cohere Model, and Spring AI

In this article, learn how to build a simple Java application using Spring AI and Amazon Bedrock to generate and compare text embeddings with Cohere’s Embed Multilingual v3 model.

April 9, 2025

by Danil Temnikov

CORE

· 73,769 Views · 22 Likes

It's 2025: How Do You Choose Between Doris and ClickHouse?

Doris or ClickHouse? Doris excels in complex SQL analytics, real-time updates, and usability, while ClickHouse offers extreme performance in single-table queries.

April 9, 2025

by Zen Hua

· 5,568 Views · 2 Likes

Achieving High Genericity in Code

Designing a generic, dynamic tool for efficiently copying complex transactional data across Oracle DB environments with minimal maintenance.

April 9, 2025

by Vaseem Anjum

· 2,941 Views · 1 Like

Spring Boot Sample Application Part 1: Introduction and Configuration

This tutorial covers building a bilingual Spring Boot application for a digital library, detailing setup, database integration, and advanced features like caching and error management.

April 9, 2025

by Liliz EQ

· 4,757 Views · 5 Likes

Building Scalable and Efficient Architectures With ECS Serverless and Event-Driven Design

Learn how to build scalable and efficient architectures using ECS serverless and event-driven design by adopting serverless architecture.

April 9, 2025

by Bal Reddy Cherlapally

· 5,920 Views · 1 Like

Why Clean Data Is the Foundation of Successful AI Systems

Poor data quality costs enterprises $406M annually. Learn in this article some key challenges and best practices for ensuring data quality in AI systems.

April 8, 2025

by Vaishali Mishra

· 4,430 Views · 2 Likes

The Latest Data Engineering Topics