Data Engineering Resources

Software Security Treat or Threat? Leveraging SBOMs to Control Your Supply Chain Chaos [Infographic]

Learn about the required and recommended SBOM components — plus key security practices — to enhance your security posture along the entire software supply chain.

August 13, 2025

by DZone Editorial

· 2,140 Views · 3 Likes

Creating Serverless Applications With AWS Lambda: A Step-by-Step Guide

Learn to build scalable, cost-efficient serverless applications with AWS Lambda through this detailed, step-by-step guide.

August 13, 2025

by Bhanuprakash Madupati

· 73,916 Views · 17 Likes

How to Know an Autonomous Driver Is Safe and Reliable?

Autonomous driving needs multi-layered evaluation with synthetic scenarios, large-scale simulation, and on-road driving, each playing a critical role.

August 13, 2025

by Chinmay Jain

· 1,738 Views · 3 Likes

Secure Private Connectivity Between VMware and Object Storage: An Enterprise Architecture Guide

This guide details how to establish secure private connectivity between VMware and Object Storage using Cloud Service Endpoints.

August 13, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 2,381 Views · 4 Likes

Building a Scalable GenAI Architecture for FinTech Workflows

This guide outlines a robust, modular GenAI architecture tailored for FinTech, enabling secure, scalable AI use across credit, fraud, KYC, and compliance domains.

August 12, 2025

by Elakkiya Daivam

· 15,760 Views · 7 Likes

Real-Time Recommendations Powered by Spanner, BigQuery, and Vector Embeddings

Through vector embeddings, this BigQuery and Spanner-powered system delivers real-time, personalized recommendations by capturing nuanced user and product similarities.

August 12, 2025

by Yogesh Tewari

· 3,428 Views · 3 Likes

Deploying Real-Time Machine Learning Models in Serverless Architectures: Balancing Latency, Cost, and Performance

Learn how to deploy real-time machine learning models in serverless environments while balancing latency, cost, and performance challenges.

August 12, 2025

by Kamalesh Jain

· 2,296 Views · 4 Likes

Declarative Pipelines in Apache Spark 4.0

Apache Spark's declarative pipelines let you define your entire data pipeline's desired outcome, and Spark handles the execution details.

August 12, 2025

by Sandeep Bishnoi

· 7,597 Views · 7 Likes

Scoped Values: Revolutionizing Java Context Management

ScopedValue in Java offers safe, immutable context propagation with clear scoping and minimal overhead—ideal for structured concurrency and virtual threads.

August 12, 2025

by Ammar Husain

CORE

· 4,401 Views · 5 Likes

Development of System Configuration Management: Introduction

We replaced open-source SCM with our own. This series shares our experience, lessons, and advice for others facing the same choice.

August 11, 2025

by Georgii Kashintsev

· 2,096 Views · 4 Likes

Data Mesh Security: How to Protect Decentralized Data Architectures

Data mesh decentralizes data ownership, creating new security gaps. This guide covers zero trust, federated governance, and observability to secure modern architectures.

August 11, 2025

by Pranjal Sharma

· 6,303 Views · 8 Likes

DSPy Framework: A Comprehensive Technical Guide With Executable Examples

DSPy improves AI development by replacing prompt engineering with patterns. This guide explores how DSPy's features enable language model applications.

August 11, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,412 Views · 6 Likes

Testing Approaches for Java Enterprise Applications With Jakarta NoSQL and Jakarta Data

Learn how testing strategies like mutation and data-driven testing improve reliability and quality in Jakarta EE apps, with practical tools and examples.

August 11, 2025

by Otavio Santana

CORE

· 2,611 Views · 7 Likes

Agentic AI vs Traditional AI Agents: What Makes Them Autonomous?

Agentic AI represents a transformative leap beyond traditional AI by demonstrating autonomy, proactive goal-setting, adaptive multi-step planning, and persistent memory.

August 8, 2025

by Sairamakrishna BuchiReddy Karri

· 2,105 Views · 2 Likes

State Machines Behind the Scenes of Flight Booking and Payments

Flight bookings rely on state machines to coordinate seat holds, payments, and retries. GCP Workflows make the process reliable and resilient.

August 8, 2025

by Ravi Teja Thutari

CORE

· 3,068 Views · 3 Likes

API Testing With Playwright: A Guide for QA Engineers and Developers

Playwright enables unified API and UI testing with support for all HTTP methods, authentication, retries, and mocks—helping build reliable backend tests fast.

August 8, 2025

by Rama Mallika Kadali

· 2,887 Views · 2 Likes

Boosting Algorithms Demystified: A Deep Dive into XGBoost With Code and Explanation

XGBoost is a fast, regularized, gradient boosting framework delivering top-tier accuracy, efficiency, and interpretability on structured data tasks

August 8, 2025

by Priyam Ganguly

· 2,197 Views · 1 Like

Designing Secure APIs: A Developer’s Guide to Authentication, Rate Limiting, and Data Validation

Secure APIs with strong authentication, rate limiting, input validation, and versioning to prevent attacks, manage traffic, and ensure long-term stability.

August 8, 2025

by Surendra Pandey

· 2,036 Views · 3 Likes

Databricks DBRX vs OpenAI GPT-4o vs Claude 3: Which LLM Is Best for Enterprise Use Cases?

Compare DBRX, GPT-4o, and Claude 3 in enterprise AI. Choose between open-source control, multimodal capability, or context-aware ethical alignment.

August 8, 2025

by Sairamakrishna BuchiReddy Karri

· 2,223 Views · 1 Like

Exploring C++23: Multidimensional Subscript Operator

C++23's multidimensional subscript operator simplifies array access, improving code readability and generic programming.

August 7, 2025

by Vishal Jain

· 2,146 Views · 1 Like

The Latest Data Engineering Topics