Data Engineering Resources

TIOBE Programming Index News June 2025: SQL Falls to Record Low Popularity

Based on the June 2025 TIOBE Programming Community Index, SQL has faded in popularity as people working in the field of AI switch to NoSQL databases.

June 18, 2025

by Megan Crouse

· 1,899 Views · 1 Like

Top Trends for Data Streaming With Apache Kafka and Flink

Explore how Apache Kafka and Apache Flink are transforming data streaming, powering real-time analytics, and shaping cloud and future-ready business systems.

June 18, 2025

by Kai Wähner

CORE

· 2,679 Views · 1 Like

A New Era of Unified Lakehouse: Who Will Reign? A Deep Dive into Apache Doris vs. ClickHouse

Apache Doris delivers unified, real-time analytics with flexible updates and high concurrency, outperforming ClickHouse on complex queries.

June 18, 2025

by Michael Hayden

· 4,127 Views · 2 Likes

The Shift of DevOps From Automation to Intelligence

The history of tech is a story of reinvention. This post explores how we are entering a new era of software intelligence.

June 18, 2025

by Arunsingh Jeyasingh Jacob

· 2,417 Views · 1 Like

Debunking LLM Intelligence: What's Really Happening Under the Hood?

Debunk LLM 'reasoning.' Go 'under the hood' to uncover the computational reality of AI's language abilities. It's about statistical power, not human thought.

June 18, 2025

by Frederic Jacquet

CORE

· 3,678 Views · 8 Likes

From OCR Bottlenecks to Structured Understanding

OCR errors cascade through RAG pipelines, killing performance. SmolDocling (256M params) processes docs holistically → structured output → better RAG.

June 18, 2025

by Pier-Jean MALANDRINO

CORE

· 2,340 Views · 3 Likes

Apache Doris and DeepSeek: Redefining Intelligent Data Analytics

This article explores how Apache Doris and DeepSeek work together to simplify and enhance real-time data analysis through natural language and powerful OLAP tools.

June 17, 2025

by Darren Xu

· 1,570 Views · 2 Likes

Elevating LLMs With Tool Use: A Simple Agentic Framework Using LangChain

Build a smart agent with LangChain that allows LLMs to look for the latest trends, search the web, and summarize results using real-time tool calling.

June 17, 2025

by Arjun Bali

· 2,878 Views · 3 Likes

Build Your Private Cloud at Home

OpenStack is a popular open-source cloud platform. Through this article, I plan to provide a guide for creating a basic OpenStack cloud at home.

June 17, 2025

by Amith Kotu

· 2,442 Views · 2 Likes

How to Achieve SOC 2 Compliance in AWS Cloud Environments

Achieving SOC 2 compliance in AWS requires planning, rigorous implementation, and ongoing commitment to security best practices.

June 17, 2025

by Chase Bolt

· 1,660 Views · 1 Like

AI's Cognitive Cost: How Over-Reliance on AI Tools Impacts Critical Thinking

Learn how over-reliance on AI tools impacts critical thinking, with insights from Michael Gerlich's 2025 study on cognitive offloading and AI usage trends.

June 17, 2025

by Srinivas Chippagiri

CORE

· 16,956 Views · 3 Likes

Driving Streaming Intelligence On-Premises: Real-Time ML With Apache Kafka and Flink

This article explores how to design, build, and deploy a predictive ML model using Flink and Kafka in an on-premises environment to power real-time analytics.

June 17, 2025

by Gautam Goswami

CORE

· 1,946 Views · 6 Likes

Why 99% Accuracy Isn't Good Enough: The Reality of ML Malware Detection

ML models need to be complemented with traditional detection techniques for malware detection to work in real enterprise environments, due to the "base rate problem."

June 16, 2025

by Udbhav Prasad

· 2,360 Views · 5 Likes

Before You Microservice Everything, Read This

Microservices are powerful but often overused. Modular monoliths offer a simpler, scalable way to structure applications, especially at the start of a project.

June 16, 2025

by Nizam Abdul Khadar

· 3,082 Views · 4 Likes

Scrum Smarter, Not Louder: AI Prompts Every Developer Should Steal

A practical guide that helps developers use AI to improve backlog grooming, retros, standups, and reviews, without waiting for the Scrum Master to save the sprint.

June 16, 2025

by Ella Mitkin

· 4,549 Views · 9 Likes

Safeguarding Cloud Databases: Best Practices and Risks Engineers Must Avoid

This article explores database security practices in cloud environments, highlighting risks like misconfigurations, insufficient encryption, and excessive privileges.

June 16, 2025

by arvind toorpu

CORE

· 2,102 Views · 2 Likes

AI Agents in PHP With Model Context Protocol

Supercharge your PHP applications with AI Agents using MCP (Model Context Protocol). Connect powerful tools to LLMs with minimal coding.

June 16, 2025

by Valerio Barbera

· 1,295 Views · 3 Likes

Monitoring and Managing the Growth of the MSDB System Database in SQL Server

The msdb system database in SQL Server is crucial for managing and maintaining tasks such as job scheduling, alerts, and database mail. Learn more about it.

June 16, 2025

by arvind toorpu

CORE

· 2,638 Views · 3 Likes