Data Engineering Resources

Developer’s Checklist: How to Build an FHE Application

This step-by-step checklist breaks down FHE app development from plaintext design to encrypted implementation and offers open-source tools to get you started.

July 6, 2026

by David Archer

· 1,178 Views

HTTP QUERY in Java: The Missing Method for Complex REST API Searches

HTTP QUERY gives Java REST APIs a cleaner way to handle complex searches with request bodies, avoiding long URLs and POST misuse while keeping reads explicit.

July 6, 2026

by Otavio Santana

CORE

· 2,378 Views

Parquet vs Lance: How Storage Layout Changes the Read Path

Parquet is scan-oriented. Lance is access-oriented. The difference is how much data the reader touches before returning results.

July 6, 2026

by Hitarth Trivedi

· 2,159 Views · 1 Like

Azure Databricks for Scalable MLOps and Feature Engineering With Apache Spark, Delta Lake, and MLflow

A practical guide to feature engineering at scale with Azure Databricks, covering distributed data processing with Spark and reliable storage with Delta Lake.

July 6, 2026

by Jubin Soni, FBCS

CORE

· 1,399 Views

LangChain With SQL Databases: Natural Language to SQL Queries

Building an SQL interface that is easy to use for NON-SQL users and provides immediate and accurate answers to business queries.

July 6, 2026

by Varun Joshi

· 1,316 Views · 1 Like

Resilience Lost in the Stack: How Abstraction Layers Silently Mask Distributed Systems’ Topology Awareness

The focus is on distributed systems resilience, specifically the integration gap between application abstractions and high-availability infrastructure layers.

July 3, 2026

by Rithra Ravikumar

· 2,129 Views

From Polling to PubSub: Building an Asynchronous OPC UA Stack in Python

The architectural design and engineering required to build a native, asynchronous OPC UA Pub/Sub (IEC 62541-14) stack in Python for the open-source opcua-asyncio library.

July 3, 2026

by Harshith Narasimhan Srivatsa

· 2,054 Views · 1 Like

Prompt Injection Attacks and Hidden Security Risks in LLM Applications

Prompt injection hijacks an LLM by exploiting its inability to separate data from commands. Direct and indirect attacks require layered defenses, not one fix.

July 3, 2026

by Karini Kapoor

· 3,057 Views · 2 Likes

Building Your API Gateway From OpenAPI Specs: A Spec-Driven Approach

Generate API gateways directly from OpenAPI specs to eliminate configuration drift, simplify maintenance, and keep your API contract as the single source of truth.

July 3, 2026

by sahil arora

· 1,584 Views

OBO SSO in Java Applications: Securely Calling Downstream APIs on Behalf of a User

OBO (On-Behalf-Of) allows a Java API to securely call downstream services using the authenticated user's identity instead of the application's identity.

July 3, 2026

by Muhammed Harris Kodavath

· 1,920 Views · 3 Likes

Building an AI Agent That Responds to Real-Time Events With AWS Bedrock, Kinesis, DynamoDB, and S3

Build an AI agent that processes real-time events with Amazon Bedrock and a serverless AWS architecture powered by Kinesis, DynamoDB, and S3.

July 3, 2026

by Jubin Soni, FBCS

CORE

· 2,308 Views · 1 Like

WebSockets, gRPC, and GraphQL in the Core

A hands-on walkthrough of building a live chat over the new core WebSocket API and typed clients from a GraphQL schema and a proto file.

July 2, 2026

by Shai Almog

CORE

· 2,498 Views · 4 Likes

Real-Time AI Feature Engineering With Spark Structured Streaming and Databricks Feature Store

How Spark Structured Streaming and the Databricks Feature Store work together to build point-in-time-correct features from Kafka events to streaming transformations.

July 2, 2026

by Jubin Soni, FBCS

CORE

· 2,392 Views

Beyond Root Cause: Building Effective Blameless Postmortems for Cloud-Native Systems

Blameless postmortems focus on learning, not blame, helping teams improve reliability, reduce recurring incidents, and strengthen resilience.

July 2, 2026

by Akshay Pratinav

· 2,460 Views

From Pilot to Production: The Six Agent Patterns That Determine Whether Your AI Program Scales or Stalls

Most AI agent programs don't fail because of technology. They fail because nobody owns the agent and nobody monitors it.

July 2, 2026

by BALAJI BARMAVAT

· 1,646 Views · 1 Like

Multi-Agent Software Engineering: One Coding Agent Isn't Enough

Multiple AI agents with clear roles and checks deliver real software better than one agent, but cost more and only suit large tasks.

July 2, 2026

by Jithu Paulose

· 2,212 Views

Dead Letter Queue Patterns in Apache Flink: Handling Poison Messages Without Stopping Your Stream

A poison message can trap a Flink job in a restart loop. Use side outputs, retries, tiered DLQs, durable sinks, and replay jobs to keep the stream running.

July 2, 2026

by Rohit Muthyala

· 3,189 Views

Apache Spark Query Optimization on Databricks: Catalyst, AQE, and Photon Engine

Spark query performance on Databricks is driven by a multi-layer optimization stack: Catalyst transforms SQL into optimized execution plans.

July 2, 2026

by Jubin Soni, FBCS

CORE

· 2,406 Views

One Stolen Key, One Stolen Token: Why Machine Identity Is Cloud-Native's Quietest Crisis — and the Only Fix That Actually Holds

Learn how stolen machine credentials fuel major cloud breaches and how policy-as-code and short-lived identities help stop modern attacks.

July 1, 2026

by Igboanugo David Ugochukwu

CORE

· 3,907 Views

Why AI-Generated Code Is Making Regression Testing More Important, Not Less

AI-generated code introduces integration failures that spec-based tests cannot catch. Regression testing grounded in real production behavior is the fix.

July 1, 2026

by Sancharini Panda

· 1,952 Views

The Latest Data Engineering Topics