Data Engineering Resources

Navigating Innovations and Challenges of Conversational AI

Large language models (LLMs) are sophisticated AI models with the ability to understand, generate, and process natural language.

March 17, 2025

by Yifei Wang

CORE

· 2,458 Views · 2 Likes

Migrating From SQLite to MySQL

Exploring the pros and cons of three methods of database migration from SQLite to MySQL: SQLite 3 + MySQL client, a Python/Django script, and a dedicated converter.

March 17, 2025

by Vlad Bilyak

· 2,625 Views · 3 Likes

All About GPU Threads, Warps, and Wavefronts

This article talks about the GPU threads concept, warps and warpSize, and subtle differences when using NVIDIA and AMD GPUs.

March 17, 2025

by Jagadish Krishnamoorthy

· 5,600 Views

Attribute-Level Governance Using Apache Iceberg Tables

This article explains how data filter options in lake formation can be fruitful in managing fine-grained access leveraging Apache Iceberg tables.

March 17, 2025

by Ankur Srivastava

· 3,745 Views · 2 Likes

Best Practices for Data Warehouses in Microsoft Fabric

Leverage Microsoft Fabric for unified data warehousing; follow best practices for schema, ingestion, transformation, security, optimization, and continuous monitoring.

March 17, 2025

by Aravind Nuthalapati

CORE

· 24,887 Views · 4 Likes

Top Terraform and OpenTofu Tools to Use in 2025

Explore the top Terraform and OpenTofu tools for 2025 to simplify infrastructure management, improve collaboration, boost security, and optimize workflows.

March 17, 2025

by Alexander Sharov

· 4,284 Views · 4 Likes

Leveraging LLMs for Software Testing

Explore how LLMs enhance Python testing by automating test case generation, improving test coverage, reducing maintenance, and supporting efficient workflows.

March 17, 2025

by Pradeesh Ashokan

· 3,242 Views · 2 Likes

Top Security Automation Tools for Auto-Remediation

Speed is vital in cybersecurity, and auto-remediation tools help by quickly detecting and mitigating risks, boosting response efficiency.

March 17, 2025

by Anastasios Arampatzis

· 4,099 Views · 2 Likes

Accelerating Deep Learning on AWS EC2

Install CUDA on AWS GPU instances, containerize your deep learning model, and scale with ECS/EKS for cost-effective, high-performance training and inference.

March 14, 2025

by Praveen Kumar Thopalle

· 5,831 Views

Build a Scalable E-commerce Platform: System Design Overview

This article explores the architecture of a distributed and scalable e-commerce platform with multiple services and components, hosted on a cloud platform like AWS.

March 14, 2025

by Prashant Nigam

· 14,661 Views · 1 Like

Queries for Optimizing and Debugging PostgreSQL Replication

Postgres replication is a powerful tool for replicating data between databases. Learn about the queries to monitor, optimize, and debug the PostgreSQL replication.

March 14, 2025

by Dr. Ibrar Ahmed

· 6,313 Views · 6 Likes

Smart Cities With Multi-Modal Retrieval-Augmented Generation

Learn how MM-RAG revolutionizes smart city management by integrating text, images, and IoT data to deliver real-time actionable insights for urban challenges.

March 14, 2025

by Shaik Abdul Kareem

· 41,761 Views · 2 Likes

Building a Real-Time AI-Powered Workplace Safety System

In this article, we'll show you how we built a real-time AI safety system that monitors workplace ergonomics using Python, MediaPipe, and OpenCV.

March 14, 2025

by Chidozie Managwu

· 4,010 Views · 2 Likes

DeepSeek on Kubernetes: AI-Powered Reasoning at Scale

Deploy DeepSeek-R1 on Kubernetes using Ollama for inference and Open WebUI for seamless interaction. Supports local setups like KIND or cloud deployment.

March 14, 2025

by Rajesh Gheware

CORE

· 5,552 Views · 3 Likes

Stop Wasting Time Writing Code for APIs

Martini automates API creation, security, and integrations — eliminating boilerplate and saving developers' time. Build faster, code less.

March 14, 2025

by David Brown

CORE

· 6,893 Views · 6 Likes

Securing Conversations With LLMs

In this article, we will explore how cloud-native open-source tools can be used to filter sensitive information both entering and exiting the models.

March 13, 2025

by Siri Varma Vegiraju

CORE

· 16,181 Views

Functional Endpoints: Alternative to Controllers in WebFlux

The article discusses functional endpoints in Spring WebFlux as an alternative to traditional controllers, using RouterFunction and HandlerFunction.

March 13, 2025

by Taras Ivashchuk

· 5,219 Views · 4 Likes

Build a REST API With Just 2 Classes in Java and Quarkus

Quarkus enables a full CRUD API with just two classes using Hibernate ORM with Panache. No controllers or repositories needed — just define two classes, and deploy.

March 13, 2025

by Otavio Santana

CORE

· 13,303 Views · 16 Likes