Data Engineering Resources

Pattern Searching and PostgreSQL Full-Text Search: Understanding the Mismatch

Learn why PostgreSQL full-text search (FTS) is great for semantic, language-aware searching, but not for raw pattern search.

October 7, 2025

by Horatiu Dan

CORE

· 4,000 Views · 11 Likes

Building Cost-Effective Internet Scale Applications

How cloud developers can build highly scalable applications with zero initial cost of running the infrastructure and scale them to millions of user requests.

October 7, 2025

by Ranjit Aneesh

· 4,012 Views · 2 Likes

Building a Production-Ready Conversational AI Agent With Cloudflare Workers and AI Gateway

Build a serverless chatbot with Cloudflare Workers for backend logic, AI Gateway for model routing, and KV for conversation history.

October 7, 2025

by Mayur Vekariya

· 4,496 Views · 1 Like

Dynamization of Static Data Structures

An intuitive explanation, along with some real-world applications of this forgotten 1980s technique for turning static data structures into dynamic ones.

October 7, 2025

by Pranet Verma

· 2,295 Views · 1 Like

Booleans vs Integers in Databases: Understanding the Trade-Offs

Booleans are simple and efficient, but don’t scale well when your data model evolves. Integers can elegantly handle multiple states, reduce schema complexity.

October 7, 2025

by Mamadou Cisse

· 1,628 Views · 2 Likes

Hyperparameter Tuning and Feature Engineering: A Guide to Optimizing Machine Learning Models

Learn how hyperparameter tuning and feature engineering boost ML performance, balancing accuracy, cost, and long-term maintainability.

October 6, 2025

by Kacper Michalik

· 2,046 Views · 2 Likes

Why GPT-OSS:20B Feels Painfully Slow (And How Quantization Can Save Your Sanity)

GPT-OSS:20B's MXFP4 quantization requires H100+ GPUs. Use GGUF quantized versions from Hugging Face for dramatically faster consumer hardware performance.

October 6, 2025

by Pavan Vemuri

CORE

· 6,014 Views · 5 Likes

LangGraph Beginner to Advanced: Part 1 — Introduction to LangGraph and Some Basic Concepts

If you’ve ever wanted to build AI agents and design graph-based conversational workflows, this course-style blog series is for you.

October 6, 2025

by Mohammed Talib

· 3,616 Views · 3 Likes

Predictable Low Latencies for Apache HBase

By utilizing a multi-tiered storage architecture, HBase delivers a cost-effective solution that ensures predictable performance for latency-sensitive OLTP workloads.

October 6, 2025

by Viraj Jasani

· 1,871 Views · 1 Like

Developing Low-Cost AI-Based Similarity Search

A simple AI-powered chatbot that work a contextual search engine powered by RAG and essentials concepts of AI like vector embeddings and cosine similarity search.

October 6, 2025

by Anton Yarkov

CORE

· 2,363 Views

7 AWS Services Every Data Engineer Should Master

In 2025, S3, Glue, Lambda, Athena, Redshift, EMR, and Kinesis form the core AWS toolkit for building fast, reliable, and scalable data pipelines.

October 6, 2025

by Sai Mounika Yedlapalli

· 4,449 Views · 3 Likes

Guardrails for AI: Protecting Privacy in Both Prompts and Responses

LLMs like ChatGPT raise privacy risks in both inputs and outputs. Learn the key threats and guardrails to protect sensitive data responsibly.

October 6, 2025

by Karthik Mahalingam

· 2,934 Views

A Brief Overview of Designing and Testing Effective Chatbots

Designing an effective chatbot involves starting from the use case, choosing the right model, tuning parameters, and testing.

October 6, 2025

by Vinayak Prasad

· 1,931 Views · 3 Likes

Enhance Development With DevoxxGenie and MCP

This blog provides a tutorial on how to integrate AI agents, specifically MCP agents, into your coding workflow using the DevoxxGenie plugin for JetBrains IDE.

October 6, 2025

by Gunter Rotsaert

CORE

· 1,767 Views

Behind the Scenes: How Apps Are Collecting Your Data

Devs add third-party SDKs to their apps, like installing pre-built windows in houses, that may include manufacturers' hidden cameras, collecting data from inside the app.

October 6, 2025

by Kanna Sekar

· 2,234 Views

Beyond a Single AI Assistant: Creating a Team Chat App Using Spring Boot and LangChain4j

Learn how to create a team chat application using Spring Boot and LangChain4j, featuring two AI assistants that communicate both with you and with each other.

October 6, 2025

by Tamas Kiss

· 1,021 Views

Enabling Risk Management With AI/ML Powered by Cloud Native Data Architecture

Leverage cloud-native architectures to improve data quality, automate risk management, and enhance ML-driven financial crime detection.

October 3, 2025

by Pradyumna Shukla

· 3,175 Views · 2 Likes

Multi-Cloud Infrastructure Challenges and Solutions

Multi-cloud brings resilience but also complexity, drift, security, and cost challenges. IaC, automation, and unified monitoring turn it into an advantage.

October 3, 2025

by Durojaye Olusegun

· 3,395 Views · 3 Likes

From Big Data to Agents: My Decade Building Systems

How a simple scraper, a few dashboards, and a lot of curiosity turned into agentic systems that actually ship value. A builder’s path.

October 3, 2025

by Nacho Corcuera

· 2,869 Views · 2 Likes

Securing the Model Context Protocol (MCP): New AI Security Risks in Agentic Workflows

MCP makes AI integration easy but opens new security risks-like shadow servers, prompt hijacking, and connector exploits. Learn how to secure your AI-powered workflows.

October 2, 2025

by Pranjal Sharma

· 7,158 Views · 7 Likes

The Latest Data Engineering Topics