Data Engineering Resources

Build a Scalable E-commerce Platform: System Design Overview

This article explores the architecture of a distributed and scalable e-commerce platform with multiple services and components, hosted on a cloud platform like AWS.

March 14, 2025

by Prashant Nigam

· 16,357 Views · 2 Likes

Queries for Optimizing and Debugging PostgreSQL Replication

Postgres replication is a powerful tool for replicating data between databases. Learn about the queries to monitor, optimize, and debug the PostgreSQL replication.

March 14, 2025

by Dr. Ibrar Ahmed

· 6,413 Views · 6 Likes

Smart Cities With Multi-Modal Retrieval-Augmented Generation

Learn how MM-RAG revolutionizes smart city management by integrating text, images, and IoT data to deliver real-time actionable insights for urban challenges.

March 14, 2025

by Shaik Abdul Kareem

· 41,919 Views · 2 Likes

Building a Real-Time AI-Powered Workplace Safety System

In this article, we'll show you how we built a real-time AI safety system that monitors workplace ergonomics using Python, MediaPipe, and OpenCV.

March 14, 2025

by Chidozie Managwu

· 4,239 Views · 2 Likes

DeepSeek on Kubernetes: AI-Powered Reasoning at Scale

Deploy DeepSeek-R1 on Kubernetes using Ollama for inference and Open WebUI for seamless interaction. Supports local setups like KIND or cloud deployment.

March 14, 2025

by Rajesh Gheware

CORE

· 5,726 Views · 3 Likes

Stop Wasting Time Writing Code for APIs

Martini automates API creation, security, and integrations — eliminating boilerplate and saving developers' time. Build faster, code less.

March 14, 2025

by David Brown

CORE

· 7,027 Views · 6 Likes

Securing Conversations With LLMs

In this article, we will explore how cloud-native open-source tools can be used to filter sensitive information both entering and exiting the models.

March 13, 2025

by Siri Varma Vegiraju

CORE

· 16,310 Views

Functional Endpoints: Alternative to Controllers in WebFlux

The article discusses functional endpoints in Spring WebFlux as an alternative to traditional controllers, using RouterFunction and HandlerFunction.

March 13, 2025

by Taras Ivashchuk

· 5,461 Views · 4 Likes

Build a REST API With Just 2 Classes in Java and Quarkus

Quarkus enables a full CRUD API with just two classes using Hibernate ORM with Panache. No controllers or repositories needed — just define two classes, and deploy.

March 13, 2025

by Otavio Santana

CORE

· 13,603 Views · 16 Likes

The Impact of AI Agents on Modern Workflows

AI agents will transform traditional workflows, making them more dynamic, self-optimizing, and intelligent for greater efficiency and innovation.

March 13, 2025

by Bhala Ranganathan

CORE

· 4,817 Views · 2 Likes

AI-Driven Self-Healing Tests With Playwright, Cucumber, and JS

Self-healing for automation testing significantly reduces maintenance by automatically adapting to changes in the application's user interface.

March 13, 2025

by Priya Yesare

· 9,782 Views · 2 Likes

Handling Concurrent Data Loads in Delta Tables

Learn to handle Delta Lake concurrency issues with retries, exponential backoff, partitioning, Auto-Optimize, MERGE, and monitoring techniques.

March 12, 2025

by munikrishnaiah sundararamaiah

· 4,937 Views · 3 Likes

Low-Code Development Is Dead; Long Live Low Code, No Limits

Old low-code is too rigid. The future is Low Code, No Limits — developer-first, API-driven, and built for real enterprise needs.

March 12, 2025

by David Brown

CORE

· 8,766 Views · 7 Likes

Lightning Data Service for Lightning Web Components

Explore the potential of Lightning Data Service in Lightning Web Components through its three core features: base components, wire adapters, and wire functions.

March 12, 2025

by Jaseem Pookandy

CORE

· 4,891 Views · 1 Like

How to Recover a Deleted Table in a SQL Server Database

Learn easy methods to recover a deleted table in SQL Server, including using backups, transaction logs, or recovery solutions, to restore lost data and minimize downtime.

March 12, 2025

by Mithilesh Tata

CORE

· 7,531 Views · 4 Likes

Build a DIY AI Model Hosting Platform With vLLM

vLLM is an open-source tool that helps with hosting AI models using an efficient inference engine. It can be used to power LLMs in real products and services.

March 12, 2025

by Bhala Ranganathan

CORE

· 5,573 Views · 1 Like

Chat History for AI Applications With Azure Cosmos DB Go SDK

Build a chat history implementation with Azure Cosmos DB for NoSQL Go SDK and LangChainGo, enhancing LLM context and enabling efficient testing with Testcontainers.

March 12, 2025

by Abhishek Gupta

CORE

· 3,995 Views · 3 Likes

Enhanced Monitoring Pipeline With Advanced RAG Optimizations

A refined RAG pipeline integrates advanced observability, rigorous evaluation metrics, end-to-end security, performance optimizations, and production-ready features.

March 11, 2025

by Praveen Kumar Thopalle

· 6,226 Views

Disaster Recovery Plan for DevOps

Ensuring business continuity requires more than just robust pipelines and agile practices in DevOps, it also requires you to have a reliable DR strategy.

March 11, 2025

by Daria Kulikova

· 4,423 Views · 4 Likes

The LLM Advantage: Smarter Time Series Predictions With Less Effort

LLMs simplify time series forecasting by handling messy data and context. Combined with stats, they cut errors by 31%, delivering better, easier forecasts.

March 11, 2025

by Vinoth Manamala Sudhakar

· 6,073 Views · 2 Likes

The Latest Data Engineering Topics