Data Engineering Resources

Unlocking AI Coding Assistants Part 1: Real-World Use Cases

Dive into some AI coding assistant use cases and their effectiveness, highlighting their capabilities and limitations.

April 21, 2025

by Gunter Rotsaert

CORE

· 3,428 Views · 1 Like

Stateless vs Stateful Stream Processing With Kafka Streams and Apache Flink

Concepts and benefits of stateless and stateful stream processing with Kafka Streams and Apache Flink vs. databases and data lakes.

April 21, 2025

by Kai Wähner

CORE

· 7,148 Views · 4 Likes

Platform Engineering for Cloud Teams

Platform engineering empowers cloud teams by streamlining infrastructure, automating workflows, and enhancing developer experience to drive efficiency and innovation.

April 21, 2025

by Josephine Eskaline Joyce

CORE

· 7,232 Views · 10 Likes

The Rise of Shadow AI: When Innovation Outpaces Governance

Employees adopt AI tools faster than governance can react. Shadow AI isn’t a threat—it’s a signal. Rather than ban it, organizations should guide it with clear policies.

April 21, 2025

by Frederic Jacquet

CORE

· 3,151 Views · 3 Likes

Simplifying Vector Embeddings With Go, Cosmos DB, and OpenAI

Learn how to build a Go web app to generate, store, and query vector embeddings using Azure Cosmos DB and OpenAI, with step-by-step guidance.

April 21, 2025

by Abhishek Gupta

CORE

· 3,882 Views · 2 Likes

AI Interview Analysis

This article discusses how to use generative artificial intelligence to analyze interviews from teammates, stakeholders, and management for better insights.

April 21, 2025

by Stefan Wolpers

CORE

· 3,436 Views · 3 Likes

Thumbnail Generator Microservice for PDF in Spring Boot

Build a utility Spring Boot microservice that converts PDF documents to PNG thumbnails with the open-source Apache PDFBox package.

April 21, 2025

by Amol Gote

CORE

· 3,166 Views · 1 Like

Vision AI on Apple Silicon: A Practical Guide to MLX-VLM

Learn how Apple's MLX framework turns your Mac into a vision AI powerhouse, running large models efficiently with native Metal optimization and minimal setup.

April 18, 2025

by Aditya Karnam Gururaj Rao

· 9,241 Views · 2 Likes

Is the Model Context Protocol a Replacement for HTTP?

MCP works with HTTP, not replaces it. It’s a higher-level framework for managing how AI models handle context, applications, and memory during interactions.

April 18, 2025

by Vijay Joshi

· 7,873 Views · 7 Likes

Why I Built the Ultimate Text Comparison Tool (And Why You Should Try It)

Learn how my comprehensive text comparison tool combines exact, fuzzy, and phonetic matching to solve your messiest data reconciliation challenges in minutes.

April 17, 2025

by Mokhtar Ebrahim

· 4,336 Views · 3 Likes

Gemma 3: Unlocking GenAI Potential Using Docker Model Runner

Run Gemma 3 locally using Docker Model Runner for private, efficient GenAI development — fast setup, offline inference, and full control.

April 17, 2025

by Anjan Kumar Ayyadapu

· 17,334 Views · 1 Like

How AI Is Changing the Way Developers Write Code

Generative AI, AI assistants, and LLMs have unique capabilities in software development. Learn how they improve workflows and maximize productivity.

April 16, 2025

by Karen Bradford

· 5,580 Views · 6 Likes

Debugging Deadlocks Using Java Synchronization Aids

This article explains how to isolate and test concurrent operations that led to deadlock and demonstrates how CountDownLatch and CyclicBarrier could help achieve this.

April 16, 2025

by Horatiu Dan

CORE

· 8,085 Views · 10 Likes

Enhancing Avro With Semantic Metadata Using Logical Types

Avro logical types add semantic meaning to primitive data types, making schemas more expressive. This blog explores their benefits and common use cases.

April 16, 2025

by Gurmeet Saran

· 6,664 Views · 2 Likes

Securing Parquet Files: Vulnerabilities, Mitigations, and Validation

Parquet files are widely used in big data ecosystems, but vulnerabilities like CVE-2025-30065 highlight the importance of secure handling.

April 15, 2025

by Vamshidhar Morusu

· 6,113 Views · 1 Like

How to Attach SQL Database Without a Transaction Log File

Learn to attach a SQL database without a log file using SSMS or T-SQL. Follow steps to seamlessly attach your database, even if the log file is missing.

April 15, 2025

by Priyanka Chauhan

· 6,288 Views · 1 Like

Why GenAI Apps Could Fail Without Agentic Frameworks

Learn why GenAI apps risk failure and how agentic frameworks empower AI to be proactive, adaptive, and capable of tackling dynamic challenges head-on!

April 15, 2025

by Haymang Ahuja

· 3,050 Views · 3 Likes

Emerging Data Architectures: The Future of Data Management

This article explores the latest advancements in data architecture, focusing on frameworks and newer paradigms such as LakeDB and zero ETL architectures.

April 15, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 7,989 Views · 10 Likes

A Deep Dive into Apache Doris Indexes

Apache Doris offers various index types, each designed for specific needs. Let’s delve into their features and discover what drives their exceptional performance.

April 14, 2025

by Darren Xu

· 6,287 Views

How Doris + Hudi Turned the Impossible Into the Everyday

Want to know how this "data giant ship" navigates the waves? Follow this article to uncover the amazing story of Doris and Hudi, the "dream team" of data.

April 14, 2025

by Zen Hua

· 5,898 Views · 4 Likes

The Latest Data Engineering Topics