Data Engineering Resources

Why I Built the Ultimate Text Comparison Tool (And Why You Should Try It)

Learn how my comprehensive text comparison tool combines exact, fuzzy, and phonetic matching to solve your messiest data reconciliation challenges in minutes.

April 17, 2025

by Mokhtar Ebrahim

· 3,531 Views · 3 Likes

Gemma 3: Unlocking GenAI Potential Using Docker Model Runner

Run Gemma 3 locally using Docker Model Runner for private, efficient GenAI development — fast setup, offline inference, and full control.

April 17, 2025

by Anjan Kumar Ayyadapu

· 4,793 Views

How AI Is Changing the Way Developers Write Code

Generative AI, AI assistants, and LLMs have unique capabilities in software development. Learn how they improve workflows and maximize productivity.

April 16, 2025

by Karen Bradford

· 4,267 Views · 5 Likes

Debugging Deadlocks Using Java Synchronization Aids

This article explains how to isolate and test concurrent operations that led to deadlock and demonstrates how CountDownLatch and CyclicBarrier could help achieve this.

April 16, 2025

by Horatiu Dan

· 5,454 Views · 6 Likes

Enhancing Avro With Semantic Metadata Using Logical Types

Avro logical types add semantic meaning to primitive data types, making schemas more expressive. This blog explores their benefits and common use cases.

April 16, 2025

by Gurmeet Saran

· 4,179 Views · 1 Like

Securing Parquet Files: Vulnerabilities, Mitigations, and Validation

Parquet files are widely used in big data ecosystems, but vulnerabilities like CVE-2025-30065 highlight the importance of secure handling.

April 15, 2025

by Vamshidhar Morusu

· 3,445 Views · 1 Like

How to Attach SQL Database Without a Transaction Log File

Learn to attach a SQL database without a log file using SSMS or T-SQL. Follow steps to seamlessly attach your database, even if the log file is missing.

April 15, 2025

by Priyanka Chauhan

· 3,570 Views · 1 Like

Why GenAI Apps Could Fail Without Agentic Frameworks

Learn why GenAI apps risk failure and how agentic frameworks empower AI to be proactive, adaptive, and capable of tackling dynamic challenges head-on!

April 15, 2025

by Haymang Ahuja

· 2,392 Views · 3 Likes

Emerging Data Architectures: The Future of Data Management

This article explores the latest advancements in data architecture, focusing on frameworks and newer paradigms such as LakeDB and zero ETL architectures.

April 15, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 4,693 Views · 7 Likes

A Deep Dive into Apache Doris Indexes

Apache Doris offers various index types, each designed for specific needs. Let’s delve into their features and discover what drives their exceptional performance.

April 14, 2025

by Darren Xu

· 3,271 Views

How Doris + Hudi Turned the Impossible Into the Everyday

Want to know how this "data giant ship" navigates the waves? Follow this article to uncover the amazing story of Doris and Hudi, the "dream team" of data.

April 14, 2025

by Zen Hua

· 3,594 Views · 3 Likes

Introducing Neuron AI: Create Full-Featured AI Agents in PHP

A complete open-source toolkit for AI development in PHP. Create RAG systems to use the powerful capabilities of LLMs on your own private data.

April 14, 2025

by Valerio Barbera

· 2,258 Views · 2 Likes

Why Generative AI and Data Streaming Are Replacing Visual Coding With Low-Code/No-Code Platforms

Low-code or no-code tools simplify development but have limitations. Generative AI and data streaming (Kafka, Flink) reshape real-time, scalable workflows.

April 14, 2025

by Kai Wähner

CORE

· 2,132 Views

Critical Thinking In The Age Of AI-Generated Code

Learn how AI-generated code impacts maintainability, productivity, and quality. Explore code reviewing, testing strategies, and best practices for long-term success.

April 14, 2025

by Stelios Manioudakis, PhD

CORE

· 23,123 Views · 7 Likes

Introducing SmallRye LLM: Injecting Langchain4J AI Services

A quick guide on how Microprofile developers can leverage the power of CDI and Microprofile features on their Langchain4J AI Services in their enterprise applications.

April 14, 2025

by BUHAKE SINDI

CORE

· 4,132 Views · 5 Likes

Design Patterns for Scalable Test Automation Frameworks

Essential design principles that improve the scalability, maintainability, and efficiency of test automation frameworks.

April 11, 2025

by Sarvesh Peddi

· 3,058 Views · 1 Like

Optimizing AI Interactions: Crafting Effective Prompts for Accurate Response Generation

In this article, see how mastering prompt engineering techniques can improve AI model performance, ensure better outputs, and address key ethical considerations.

April 11, 2025

by Matthew McMullen

· 2,639 Views · 2 Likes

Transforming Data Analytics by Combining SQL and ML

Learn how AI and ML extend SQL's capabilities for advanced analytics, predictive insights, and query optimization, transforming database interactions.

April 10, 2025

by Ramalakshmi Murugan

· 4,274 Views · 1 Like

Java UDFs and Stored Procedures for Data Engineers: A Hands-On Guide

See how to build Java-based stored procedures and UDFs in Snowflake using Snowpark APIs for scalable, efficient data workflows, including async processing and file handling.

April 10, 2025

by Fawaz Ghali, PhD

CORE

· 5,201 Views · 3 Likes

Python Packages for Validating Database Migration Projects

This article analyzes three widely used Python libraries — Pandas, SQLAlchemy, and PyMySQL/psycopg2 — detailing their capabilities, advantages, and limitations.

April 10, 2025

by Vignesh Govindarajan Ravichandran

· 2,700 Views

The Latest Data Engineering Topics