Data Engineering Resources

From OCR Bottlenecks to Structured Understanding

OCR errors cascade through RAG pipelines, killing performance. SmolDocling (256M params) processes docs holistically → structured output → better RAG.

June 18, 2025

by Pier-Jean MALANDRINO

CORE

· 2,426 Views · 3 Likes

Apache Doris and DeepSeek: Redefining Intelligent Data Analytics

This article explores how Apache Doris and DeepSeek work together to simplify and enhance real-time data analysis through natural language and powerful OLAP tools.

June 17, 2025

by Darren Xu

· 1,610 Views · 2 Likes

Elevating LLMs With Tool Use: A Simple Agentic Framework Using LangChain

Build a smart agent with LangChain that allows LLMs to look for the latest trends, search the web, and summarize results using real-time tool calling.

June 17, 2025

by Arjun Bali

· 2,966 Views · 3 Likes

Build Your Private Cloud at Home

OpenStack is a popular open-source cloud platform. Through this article, I plan to provide a guide for creating a basic OpenStack cloud at home.

June 17, 2025

by Amith Kotu

· 2,491 Views · 2 Likes

How to Achieve SOC 2 Compliance in AWS Cloud Environments

Achieving SOC 2 compliance in AWS requires planning, rigorous implementation, and ongoing commitment to security best practices.

June 17, 2025

by Chase Bolt

· 1,699 Views · 1 Like

AI's Cognitive Cost: How Over-Reliance on AI Tools Impacts Critical Thinking

Learn how over-reliance on AI tools impacts critical thinking, with insights from Michael Gerlich's 2025 study on cognitive offloading and AI usage trends.

June 17, 2025

by Srinivas Chippagiri

CORE

· 17,099 Views · 3 Likes

Driving Streaming Intelligence On-Premises: Real-Time ML With Apache Kafka and Flink

This article explores how to design, build, and deploy a predictive ML model using Flink and Kafka in an on-premises environment to power real-time analytics.

June 17, 2025

by Gautam Goswami

CORE

· 2,005 Views · 6 Likes

Why 99% Accuracy Isn't Good Enough: The Reality of ML Malware Detection

ML models need to be complemented with traditional detection techniques for malware detection to work in real enterprise environments, due to the "base rate problem."

June 16, 2025

by Udbhav Prasad

· 2,444 Views · 5 Likes

Before You Microservice Everything, Read This

Microservices are powerful but often overused. Modular monoliths offer a simpler, scalable way to structure applications, especially at the start of a project.

June 16, 2025

by Nizam Abdul Khadar

· 3,210 Views · 4 Likes

Scrum Smarter, Not Louder: AI Prompts Every Developer Should Steal

A practical guide that helps developers use AI to improve backlog grooming, retros, standups, and reviews, without waiting for the Scrum Master to save the sprint.

June 16, 2025

by Ella Mitkin

· 4,633 Views · 9 Likes

Safeguarding Cloud Databases: Best Practices and Risks Engineers Must Avoid

This article explores database security practices in cloud environments, highlighting risks like misconfigurations, insufficient encryption, and excessive privileges.

June 16, 2025

by arvind toorpu

CORE

· 2,199 Views · 2 Likes

AI Agents in PHP With Model Context Protocol

Supercharge your PHP applications with AI Agents using MCP (Model Context Protocol). Connect powerful tools to LLMs with minimal coding.

June 16, 2025

by Valerio Barbera

· 1,323 Views · 3 Likes

Monitoring and Managing the Growth of the MSDB System Database in SQL Server

The msdb system database in SQL Server is crucial for managing and maintaining tasks such as job scheduling, alerts, and database mail. Learn more about it.

June 16, 2025

by arvind toorpu

CORE

· 2,713 Views · 3 Likes

Create POM With LLM (GitHub Copilot) and Playwright MCP

Learn how to build a scalable, AI-powered test automation framework using Playwright MCP, GitHub Copilot, and the Page Object Model design pattern.

June 13, 2025

by Kailash Pathak

CORE

· 4,901 Views · 5 Likes

Smarter IoT Systems With Edge Computing and AI

IoT Systems can be enhanced and improved in terms of efficiency through the use of artificial intelligence and edge computing

June 13, 2025

by Surendra Pandey

· 2,717 Views · 3 Likes

AI Agent Architectures: Patterns, Applications, and Implementation Guide

AI agent architectures provide structural blueprints for designing intelligent systems that perceive environments, process information, and execute actions.

June 13, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 7,026 Views · 7 Likes

When Incentives Sabotage Product Strategy

Learn in this article how to tackle incentives sabotaging product strategy with strategic rejection techniques that align goals, improve focus, and build trust.

June 13, 2025

by Stefan Wolpers

CORE

· 1,802 Views · 5 Likes

RAG vs. CAG: A Deep Dive into Context-Aware AI Generation Techniques

RAG retrieves external knowledge to ground AI responses, while CAG uses internal context for personalization—combine both for smarter, context-aware systems.

June 13, 2025

by Rambabu Bandam

· 4,328 Views · 2 Likes

Exploring the IBM App Connect Enterprise SELECT, ROW and THE Functions in ESQL

This article is all about the different ways you can use SELECT in IBM App Connect Enterprise: returning arrays, rows, or just that one perfect value.

June 13, 2025

by Matthias Blomme

· 1,583 Views

Modernizing Financial Systems: The Critical Role of Cloud-Based Microservices Optimization

Cloud-based microservices enhance fintech by cutting costs by 30%, accelerating recovery by 40%, and boosting uptime to 99%.

June 13, 2025

by Sibasis Padhi

· 2,491 Views · 2 Likes

The Latest Data Engineering Topics